00000001:02000400:1.0F:1788850781.485272:0:2964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788850799.229376:0:3185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788850801.065734:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 707 MB/s 00000001:01000000:2.0:1788850801.322971:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 624 MB/s 00000001:01000000:3.0F:1788850801.572969:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4031 MB/s 00000020:02000000:1.0:1788850802.293350:0:3277:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_ga87ca5d 00000400:02000000:3.0:1788850803.359610:0:3292:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.106@tcp [8/256/0/180] 00008000:02000000:0.0F:1788850806.648123:0:3441:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788850866.462632:0:5262:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788850876.080766:0:5842:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788850876.080772:0:5842:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788850876.080971:0:5842:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000a1f74745 00000080:02000400:1.0:1788850876.080980:0:5842:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788850876.091721:0:5842:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788850876.091735:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788850876.092239:0:5842:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000d2884f77) 00000020:00000080:2.0:1788850876.092261:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788850876.105678:0:5842:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788850876.106110:0:5842:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788850876.140040:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788850876.140080:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788850876.140100:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788850876.141430:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788850876.141460:0:5842:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788850876.142703:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788850876.142714:0:5842:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788850876.142726:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ad3e1a879576838 00000020:01000004:3.0:1788850876.142736:0:5842:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788850876.142740:0:5842:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788850876.142745:0:5842:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a1f74745 from MGS 00000020:01000004:3.0:1788850876.142750:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788850876.143265:0:5842:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000d9537620) 00000020:00000080:3.0:1788850876.143281:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788850876.143399:0:5842:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a1f74745 from MGS, refs=2 00080000:01000000:3.0:1788850876.143405:0:5842:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788850876.143410:0:5842:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ad3e1a879576846 00000100:00100000:3.0:1788850876.143715:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788850876.143870:0:5842:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788850876.143876:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788850876.144505:0:5842:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788850876.144513:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788850876.145386:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788850876.145754:0:5842:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788850876.145760:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788850876.146679:0:5842:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788850876.146687:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788850876.147081:0:5842:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788850876.147087:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788850876.148328:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850876.148335:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850876.148337:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850876.148670:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850876.148672:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850876.148674:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850876.149530:0:5842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788850876.156693:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788850876.398881:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3375 MB/s 00000001:01000000:0.0:1788850876.650755:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4099 MB/s 00000001:01000000:1.0:1788850876.900926:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 685 MB/s 00000001:01000000:2.0:1788850877.154910:0:5842:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 578 MB/s 00080000:10000000:3.0:1788850877.164438:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1788850877.189434:0:5842:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788850877.189450:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788850877.189453:0:5842:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788850877.190189:0:5852:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788850877.190250:0:5842:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788850877.190299:0:5842:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788850877.190520:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788850877.190544:0:5842:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788850877.191007:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788850877.191165:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788850877.191171:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788850877.201121:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788850877.201136:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788850877.207246:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788850877.207261:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788850877.207533:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788850877.207554:0:5842:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.106@tcp' 00000020:01000004:0.0:1788850877.207556:0:5842:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:1.0:1788850877.207753:0:5857:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:0.0:1788850877.208050:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.106@tcp (typ=mgc) 00000020:00000080:0.0:1788850877.208071:0:5842:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.106@tcp (0000000078460577) 00000020:00000080:0.0:1788850877.208100:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788850877.208203:0:5842:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000519f2e4a@MGC192.168.204.106@tcp: add connection 192.168.204.106@tcp at head 00010000:00010000:0.0:1788850877.208350:0:5842:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.106@tcp-0 is initialized 00000040:01000000:0.0:1788850877.208356:0:5842:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 1 is initialized 00010000:00010000:3.0:1788850877.214479:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788850877.219862:0:5858:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788850877.220008:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.106@tcp (uuid ad19e61b-7666-4fee-85e9-385935a96ab4) 00000020:00000080:2.0:1788850877.220033:0:5842:0:(genops.c:1384:class_connect()) connect: client ad19e61b-7666-4fee-85e9-385935a96ab4, cookie 0x7ad3e1a879576854 00000100:00080000:2.0:1788850877.220045:0:5842:0:(import.c:545:import_select_connection()) MGC192.168.204.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788850877.220057:0:5842:0:(import.c:666:import_select_connection()) MGC192.168.204.106@tcp: import 00000000519f2e4a using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1788850877.220113:0:5842:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000096b39bc0 x1875746019606656/t0(0) o250->MGC192.168.204.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788850877.220141:0:5842:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ad19e61b-7666-4fee-85e9-385935a96ab4->MGS 00000020:01000004:2.0:1788850877.220161:0:5842:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788850877.220167:0:5842:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788850877.220191:0:5842:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000041cb6818) 00000020:00000080:2.0:1788850877.220202:0:5842:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788850877.221304:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096b39bc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad19e61b-7666-4fee-85e9-385935a96ab4:3307:1875746019606656:0@lo:250: 00000100:00100000:0.0:1788850877.221405:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850877.225001:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019606656 00000100:00100000:1.0:1788850877.225018:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019606656 00000100:00100000:1.0:1788850877.228987:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788850877.228998:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002ec72123 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1875746019606656:12345-0@lo:250: 00010000:00080000:1.0:1788850877.229026:0:5853:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from ad19e61b-7666-4fee-85e9-385935a96ab4@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:1.0:1788850877.229065:0:5853:0:(genops.c:1384:class_connect()) connect: client ad19e61b-7666-4fee-85e9-385935a96ab4, cookie 0x7ad3e1a879576862 00000100:00080000:1.0:1788850877.231008:0:5853:0:(import.c:65:import_set_state_nolock()) 000000003156c1bf : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788850877.231120:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002ec72123 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+5:3307:x1875746019606656:12345-0@lo:250: Request processed in 2119us (9713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850877.231130:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788850877.231802:0:3307:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788850877.231813:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.106@tcp: connect to target with instance 0 00000100:00080000:1.0:1788850877.231832:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788850877.231837:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788850877.231840:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000519f2e4a MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788850877.231843:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788850877.231852:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788850877.231857:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096b39bc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad19e61b-7666-4fee-85e9-385935a96ab4:3307:1875746019606656:0@lo:250: 00000100:00100000:2.0:1788850877.236638:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788850877.237017:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788850877.237024:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788850877.238053:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788850877.238063:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788850877.238568:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788850877.238634:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788850877.239548:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788850877.240008:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788850877.240013:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788850877.241448:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788850877.241458:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788850877.288281:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788850877.288502:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788850877.288509:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788850877.290285:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788850877.290298:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788850877.291160:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788850877.291397:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788850877.291402:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788850877.295273:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788850877.295290:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788850877.296081:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788850877.296385:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788850877.296391:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788850877.297564:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788850877.297645:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788850877.298555:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788850877.299113:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788850877.299127:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788850877.300014:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788850877.300023:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788850877.344139:0:5842:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788850877.344974:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788850877.344983:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788850877.348263:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788850877.348279:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788850877.349279:0:5842:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788850877.349289:0:5842:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788850877.355123:0:5842:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788850877.355637:0:5842:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788850877.355655:0:5842:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788850877.355889:0:5842:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788850877.355923:0:5842:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.106@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788850877.355927:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788850877.355928:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788850877.355930:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788850877.355931:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788850877.355933:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788850877.355934:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788850877.355935:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788850877.355936:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788850877.355938:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788850877.355939:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788850877.355940:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788850877.355941:0:5842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788850877.355943:0:5842:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788850877.355945:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788850877.355946:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788850877.355947:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788850877.355948:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788850877.355950:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788850877.355951:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788850877.355951:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788850877.355952:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788850877.355953:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788850877.355954:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788850877.355955:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788850877.355956:0:5842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788850877.355987:0:5842:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788850877.356006:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cac256a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019606784:0@lo:253: 00000100:00100000:2.0:1788850877.356112:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850877.356302:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efb61dc7 going to sleep for 11 seconds 00000100:00100000:0.0:1788850877.356429:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019606784 00000100:00100000:0.0:1788850877.356436:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019606784 00000100:00100000:0.0:1788850877.356517:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788850877.356527:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a68eee79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+5:5842:x1875746019606784:12345-0@lo:253: 20000000:01000000:0.0:1788850877.356583:0:5856:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788850877.356586:0:5856:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788850877.357101:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788850877.357248:0:5856:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1788850877.357705:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788850877.363987:0:5878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788850877.365242:0:5856:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788850877.365249:0:5856:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788850877.365256:0:5856:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788850877.365259:0:5856:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788850877.365283:0:5856:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788850877.365545:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788850877.367371:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788850877.367400:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788850877.367464:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788850877.367512:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788850877.367548:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788850877.368496:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788850877.368512:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788850877.369351:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788850877.369368:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788850877.369417:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788850877.369426:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788850877.369458:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788850877.369511:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788850877.369564:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788850877.370433:0:5856:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788850877.370470:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788850877.370968:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788850877.370987:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788850877.371030:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788850877.372349:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788850877.372424:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788850877.372443:0:5856:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788850877.372559:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788850877.372572:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788850877.372617:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788850877.372650:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788850877.372712:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788850877.372726:0:5856:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788850877.372837:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788850877.372848:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788850877.372880:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788850877.372914:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788850877.373506:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788850877.373558:0:5856:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788850877.374375:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788850877.384869:0:5879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788850877.385378:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788850877.385409:0:5856:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.106@tcp for mdt 20000000:01000000:0.0:1788850877.385412:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.106@tcp (null) (null) (null) 00000040:00080000:0.0:1788850877.385447:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788850877.385473:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788850877.385509:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788850877.385517:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.106@tcp (null) (null) 00000040:00080000:0.0:1788850877.385564:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788850877.385593:0:5856:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788850877.385630:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788850877.385668:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788850877.385765:0:5856:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788850877.385768:0:5856:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788850877.385772:0:5856:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788850877.385825:0:5856:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788850877.385828:0:5856:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788850877.385858:0:5856:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788850877.385861:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788850877.387519:0:5880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788850877.388140:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788850877.388573:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788850877.388773:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:0.0:1788850877.388960:0:5856:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788850877.388963:0:5856:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788850877.398102:0:5881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788850877.403348:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788850877.403408:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788850877.403483:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:0.0:1788850877.403500:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788850877.403503:0:5856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788850877.403508:0:5856:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788850877.403510:0:5856:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788850877.403516:0:5856:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788850877.403523:0:5856:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788850877.404666:0:5882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788850877.405476:0:5856:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788850877.430167:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788850877.430225:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788850877.430306:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788850877.430336:0:5856:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788850877.430359:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000cc7a39d/0x7ad3e1a879576869 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850877.430376:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000cc7a39d/0x7ad3e1a879576869 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850877.430387:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000cc7a39d/0x7ad3e1a879576869 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850877.430394:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000cc7a39d/0x7ad3e1a879576869 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850877.430400:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000cc7a39d/0x7ad3e1a879576869 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850877.430407:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000cc7a39d/0x7ad3e1a879576869 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850877.430414:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000cc7a39d already unused, calling callback (000000002a9799c3) 00010000:00010000:1.0:1788850877.430417:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000cc7a39d/0x7ad3e1a879576869 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850877.430441:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000cc7a39d/0x7ad3e1a879576869 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850877.430454:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000cc7a39d/0x7ad3e1a879576869 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850877.430462:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000cc7a39d/0x7ad3e1a879576869 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850877.430467:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000cc7a39d/0x7ad3e1a879576869 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788850877.430485:0:5856:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788850877.643512:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a68eee79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+5:5842:x1875746019606784:12345-0@lo:253: Request processed in 286979us (287393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850877.643559:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788850877.643719:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cac256a1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019606784:0@lo:253: 10000000:01000000:3.0:1788850877.643736:0:5842:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788850877.643740:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788850877.643742:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788850877.643743:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788850877.643745:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788850877.643746:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788850877.643747:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788850877.643749:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788850877.643750:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788850877.643751:0:5842:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788850877.643753:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788850877.643754:0:5842:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788850877.643772:0:5842:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a1f74745 from lustre-MDT0000 10000000:01000000:3.0:1788850877.643819:0:5842:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788850877.643822:0:5842:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788850877.643828:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a9b90470000 10000000:01000000:3.0:1788850877.643832:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788850877.643842:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a9b90470000 from 1 10000000:01000000:3.0:1788850877.643851:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788850877.643903:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000902dedb5/0x7ad3e1a879576870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850877.643914:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000902dedb5/0x7ad3e1a879576870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850877.643923:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000902dedb5/0x7ad3e1a879576870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850877.643942:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb943721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019606912:0@lo:101: 00000100:00100000:3.0:1788850877.643990:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850877.644049:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e00094f3 going to sleep for 11 seconds 00000100:00100000:2.0:1788850877.644113:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019606912 00000100:00100000:2.0:1788850877.644120:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019606912 00000100:00100000:2.0:1788850877.644162:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788850877.644170:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000936bdf58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+5:5842:x1875746019606912:12345-0@lo:101: 00010000:00010000:2.0:1788850877.644183:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850877.644197:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d9aac726/0x7ad3e1a879576877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576870 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850877.644217:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d9aac726/0x7ad3e1a879576877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576870 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850877.644226:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d9aac726/0x7ad3e1a879576877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576870 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850877.644234:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d9aac726, rc 0) 00000100:00100000:2.0:1788850877.644271:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000936bdf58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+6:5842:x1875746019606912:12345-0@lo:101: Request processed in 102us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850877.644277:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788850877.644349:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb943721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019606912:0@lo:101: 00010000:00010000:3.0:1788850877.644361:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000902dedb5/0x7ad3e1a879576870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576877 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850877.644369:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000902dedb5/0x7ad3e1a879576870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576877 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850877.644409:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb943721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019607040:0@lo:501: 00000100:00100000:3.0:1788850877.644430:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850877.644448:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e00094f3 going to sleep for 11 seconds 00000100:00100000:2.0:1788850877.644496:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607040 00000100:00100000:2.0:1788850877.644499:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607040 00000100:00100000:2.0:1788850877.644525:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788850877.644530:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aa4b9847 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+6:5842:x1875746019607040:12345-0@lo:501: 00000100:00100000:2.0:1788850877.644742:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aa4b9847 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+6:5842:x1875746019607040:12345-0@lo:501: Request processed in 212us (310us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788850877.644750:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788850877.644961:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb943721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019607040:0@lo:501: 10000000:01000000:3.0:1788850877.644984:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788850877.645005:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000902dedb5/0x7ad3e1a879576870 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576877 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850877.645013:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000902dedb5/0x7ad3e1a879576870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576877 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850877.645027:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a9ba0462000 10000000:01000000:3.0:1788850877.645030:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788850877.645035:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a9ba0462000 10000000:01000000:3.0:1788850877.645037:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788850877.645040:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a9ba0462000 from 1 10000000:01000000:3.0:1788850877.645042:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788850877.645058:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000774eab61/0x7ad3e1a87957687e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850877.645064:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000774eab61/0x7ad3e1a87957687e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850877.645071:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000774eab61/0x7ad3e1a87957687e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850877.645093:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb943721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019607168:0@lo:101: 00000100:00100000:3.0:1788850877.645119:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850877.645137:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e00094f3 going to sleep for 11 seconds 00000100:00100000:2.0:1788850877.645194:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607168 00000100:00100000:2.0:1788850877.645199:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607168 00000100:00100000:2.0:1788850877.645234:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788850877.645239:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000037425744 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+6:5842:x1875746019607168:12345-0@lo:101: 00010000:00010000:2.0:1788850877.645246:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850877.645254:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ca1c5337/0x7ad3e1a879576885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a87957687e expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850877.645268:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca1c5337/0x7ad3e1a879576885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a87957687e expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850877.645275:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ca1c5337/0x7ad3e1a879576885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a87957687e expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850877.645282:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ca1c5337, rc 0) 00000100:00100000:2.0:1788850877.645308:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000037425744 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+7:5842:x1875746019607168:12345-0@lo:101: Request processed in 69us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850877.645314:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788850877.645434:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb943721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019607168:0@lo:101: 00010000:00010000:3.0:1788850877.645444:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000774eab61/0x7ad3e1a87957687e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576885 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850877.645450:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000774eab61/0x7ad3e1a87957687e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576885 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850877.645460:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788850877.645473:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000774eab61/0x7ad3e1a87957687e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576885 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850877.645490:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000774eab61/0x7ad3e1a87957687e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576885 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850877.645496:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788850877.645499:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788850877.645504:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a9ba0462000 10000000:01000000:3.0:1788850877.645506:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788850877.645509:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788850877.645511:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788850877.645524:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000ffe5cbea/0x7ad3e1a87957688c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850877.645530:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000ffe5cbea/0x7ad3e1a87957688c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850877.645548:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000ffe5cbea/0x7ad3e1a87957688c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850877.645558:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb943721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019607296:0@lo:101: 00000100:00100000:3.0:1788850877.645584:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850877.645604:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e00094f3 going to sleep for 11 seconds 00000100:00100000:0.0:1788850877.645704:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607296 00000100:00100000:0.0:1788850877.645715:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607296 00000100:00100000:0.0:1788850877.645741:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788850877.645746:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000099461de2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+7:5842:x1875746019607296:12345-0@lo:101: 00010000:00010000:0.0:1788850877.645753:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850877.645761:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000173a4336/0x7ad3e1a879576893 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a87957688c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850877.645774:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000173a4336/0x7ad3e1a879576893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a87957688c expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850877.645808:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000173a4336/0x7ad3e1a879576893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a87957688c expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850877.645815:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000173a4336, rc 0) 00000100:00100000:0.0:1788850877.645849:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000099461de2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+8:5842:x1875746019607296:12345-0@lo:101: Request processed in 103us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850877.645855:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788850877.645966:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb943721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019607296:0@lo:101: 00010000:00010000:3.0:1788850877.645975:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000ffe5cbea/0x7ad3e1a87957688c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576893 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850877.645982:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000ffe5cbea/0x7ad3e1a87957688c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576893 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850877.646033:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb943721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019607424:0@lo:501: 00000100:00100000:3.0:1788850877.646057:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850877.646095:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e00094f3 going to sleep for 11 seconds 00000100:00100000:2.0:1788850877.646145:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607424 00000100:00100000:2.0:1788850877.646150:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607424 00000100:00100000:2.0:1788850877.646178:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788850877.646183:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000145b5593 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+8:5842:x1875746019607424:12345-0@lo:501: 00000100:00100000:2.0:1788850877.646387:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000145b5593 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+9:5842:x1875746019607424:12345-0@lo:501: Request processed in 204us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850877.646394:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788850877.646501:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb943721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019607424:0@lo:501: 00000100:00100000:3.0:1788850877.646527:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb943721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019607552:0@lo:503: 00000100:00100000:3.0:1788850877.646577:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850877.646638:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e00094f3 going to sleep for 11 seconds 00000100:00100000:0.0:1788850877.646729:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607552 00000100:00100000:0.0:1788850877.646735:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607552 00000100:00100000:0.0:1788850877.646840:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788850877.646848:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000462e5b63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+9:5842:x1875746019607552:12345-0@lo:503: 00000100:00100000:0.0:1788850877.647003:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000462e5b63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+9:5842:x1875746019607552:12345-0@lo:503: Request processed in 157us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850877.647010:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788850877.647164:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb943721 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019607552:0@lo:503: 00000100:00100000:3.0:1788850877.647559:0:5884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb943721 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:5884:1875746019607680:0@lo:502: 00000100:00100000:3.0:1788850877.647599:0:5884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850877.647735:0:5884:0:(client.c:2716:ptlrpc_set_wait()) set 00000000353d71c9 going to sleep for 11 seconds 00000100:00100000:2.0:1788850877.647873:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607680 00000100:00100000:2.0:1788850877.647879:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607680 00000100:00100000:3.0:1788850877.648111:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788850877.648119:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000072267c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+9:5884:x1875746019607680:12345-0@lo:502: 00000100:00100000:3.0:1788850877.648306:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000072267c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+9:5884:x1875746019607680:12345-0@lo:502: Request processed in 188us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850877.648313:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788850877.648386:0:5884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb943721 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:5884:1875746019607680:0@lo:502: 00000020:01000000:1.0:1788850877.648414:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850877.648424:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850877.648426:0:5884:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788850877.648431:0:5884:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788850877.648433:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788850877.648453:0:5884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000249d840) 00000020:00000080:1.0:1788850877.648470:0:5884:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788850877.648475:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788850877.648660:0:5884:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788850877.648667:0:5884:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ad3e1a8795768a1 00000020:00000080:1.0:1788850877.648935:0:5884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788850877.648940:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850877.648944:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850877.648946:0:5884:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788850877.648948:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850877.648952:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850877.648958:0:5884:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788850877.648962:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788850877.648968:0:5884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000006bdfd391) 00000020:00000080:1.0:1788850877.648977:0:5884:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788850877.648980:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788850877.648981:0:5884:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788850877.648984:0:5884:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788850877.648989:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788850877.649031:0:5884:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a1f74745 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788850877.649041:0:5884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000eb51a886) 00000020:00000080:1.0:1788850877.649048:0:5884:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788850877.649111:0:5884:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788850877.649116:0:5884:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ad3e1a8795768b6 00000020:00000080:1.0:1788850877.649217:0:5884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788850877.649223:0:5884:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788850877.649228:0:5884:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7ad3e1a8795768bd 00080000:01000000:1.0:1788850877.649233:0:5884:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788850877.649235:0:5884:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ad3e1a8795768c4 00080000:10000000:1.0:1788850877.652328:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788850877.653760:0:5884:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788850877.663970:0:5884:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788850877.782811:0:5884:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788850877.784315:0:5884:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788850877.788242:0:5884:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788850877.789094:0:5884:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788850877.865973:0:5884:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000005d51de57) 00000020:00000080:0.0:1788850877.865998:0:5884:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788850877.866077:0:5884:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788850877.866096:0:5884:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ad3e1a8795768d2 00000020:00000080:0.0:1788850877.866812:0:5884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788850877.869355:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788850877.953455:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788850877.977411:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788850877.999705:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788850878.030218:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788850878.060618:0:5884:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1788850878.099613:0:5884:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7ad3e1a8795768d9 00000020:00000080:1.0:1788850878.100144:0:5884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788850878.100156:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850878.100163:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850878.100165:0:5884:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788850878.100168:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850878.100173:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850878.100174:0:5884:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788850878.100177:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788850878.100179:0:5884:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788850878.100181:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850878.100191:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850878.100192:0:5884:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788850878.100195:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850878.100200:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850878.100201:0:5884:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788850878.100206:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788850878.100246:0:5884:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788850878.100308:0:5884:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088cdf5a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:5884:1875746019607808:0@lo:502: 00000100:00100000:1.0:1788850878.100390:0:5884:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850878.100445:0:5884:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a7370477 going to sleep for 11 seconds 00000100:00100000:2.0:1788850878.100504:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607808 00000100:00100000:2.0:1788850878.100511:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607808 00000100:00100000:2.0:1788850878.100557:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788850878.100565:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007695052d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+9:5884:x1875746019607808:12345-0@lo:502: 00000100:00100000:2.0:1788850878.101046:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007695052d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+9:5884:x1875746019607808:12345-0@lo:502: Request processed in 481us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850878.101055:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788850878.101157:0:5884:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088cdf5a8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:5884:1875746019607808:0@lo:502: 00000020:01000000:1.0:1788850878.101183:0:5884:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850878.101187:0:5884:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850878.101189:0:5884:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788850878.101191:0:5884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788850878.101397:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788850878.101414:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788850878.101432:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000ffe5cbea/0x7ad3e1a87957688c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576893 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850878.101443:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000ffe5cbea/0x7ad3e1a87957688c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576893 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850878.101451:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a9ba0462000 from 1 10000000:01000000:2.0:1788850878.101454:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788850878.101480:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000386fbd6b/0x7ad3e1a8795768e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850878.101487:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000386fbd6b/0x7ad3e1a8795768e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850878.101495:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000386fbd6b/0x7ad3e1a8795768e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850878.101506:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a2b2720 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019607936:0@lo:101: 00000100:00100000:2.0:1788850878.101621:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850878.101646:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f342abc1 going to sleep for 11 seconds 00000100:00100000:3.0:1788850878.101697:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019607936 00000100:00100000:3.0:1788850878.101703:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019607936 00000100:00100000:3.0:1788850878.101734:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788850878.101749:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000382149b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+9:5842:x1875746019607936:12345-0@lo:101: 00010000:00010000:3.0:1788850878.101761:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850878.101776:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc424c4b/0x7ad3e1a8795768e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a8795768e0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850878.101830:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc424c4b/0x7ad3e1a8795768e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a8795768e0 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850878.101849:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc424c4b/0x7ad3e1a8795768e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a8795768e0 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850878.101858:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc424c4b, rc 0) 00000100:00100000:3.0:1788850878.101884:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000382149b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+10:5842:x1875746019607936:12345-0@lo:101: Request processed in 137us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850878.101890:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788850878.102064:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a2b2720 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019607936:0@lo:101: 00010000:00010000:2.0:1788850878.102086:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000386fbd6b/0x7ad3e1a8795768e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795768e7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850878.102106:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000386fbd6b/0x7ad3e1a8795768e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a8795768e7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850878.102717:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a2b2720 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019608064:0@lo:256: 00000100:00100000:2.0:1788850878.102759:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850878.102815:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f342abc1 going to sleep for 11 seconds 00000100:00100000:1.0:1788850878.102951:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608064 00000100:00100000:1.0:1788850878.102957:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608064 00000100:00100000:1.0:1788850878.102986:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788850878.102994:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007e61f387 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+10:5842:x1875746019608064:12345-0@lo:256: 20000000:01000000:1.0:1788850878.103009:0:5856:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788850878.103015:0:5856:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788850878.103112:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007e61f387 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+10:5842:x1875746019608064:12345-0@lo:256: Request processed in 119us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850878.103119:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788850878.103153:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a2b2720 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019608064:0@lo:256: 10000000:01000000:1.0:1788850878.103761:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788850878.103778:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000386fbd6b/0x7ad3e1a8795768e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795768e7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850878.103826:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000386fbd6b/0x7ad3e1a8795768e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795768e7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850878.103834:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9ba0462000 from 1 10000000:01000000:1.0:1788850878.103907:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788850878.103934:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 000000000cc7a39d/0x7ad3e1a8795768ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850878.103941:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 000000000cc7a39d/0x7ad3e1a8795768ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850878.103948:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 000000000cc7a39d/0x7ad3e1a8795768ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850878.103962:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088cdf5a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019608192:0@lo:101: 00000100:00100000:1.0:1788850878.103997:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850878.104024:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 000000009dad3abc going to sleep for 11 seconds 00000100:00100000:1.0:1788850878.104053:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608192 00000100:00100000:1.0:1788850878.104058:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608192 00000100:00100000:1.0:1788850878.104095:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788850878.104101:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009cbd111e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+10:5842:x1875746019608192:12345-0@lo:101: 00010000:00010000:1.0:1788850878.104110:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850878.104122:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fced8b82/0x7ad3e1a8795768f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a8795768ee expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850878.104141:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fced8b82/0x7ad3e1a8795768f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a8795768ee expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850878.104149:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fced8b82/0x7ad3e1a8795768f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a8795768ee expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850878.104163:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fced8b82, rc 0) 00000100:00100000:1.0:1788850878.104191:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009cbd111e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+11:5842:x1875746019608192:12345-0@lo:101: Request processed in 91us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850878.104196:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788850878.104231:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088cdf5a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019608192:0@lo:101: 00010000:00010000:1.0:1788850878.104242:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 000000000cc7a39d/0x7ad3e1a8795768ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795768f5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850878.104250:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 000000000cc7a39d/0x7ad3e1a8795768ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a8795768f5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850878.104291:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000088cdf5a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019608320:0@lo:501: 00000100:00100000:1.0:1788850878.104314:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850878.104325:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 000000009dad3abc going to sleep for 11 seconds 00000100:00100000:1.0:1788850878.104336:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608320 00000100:00100000:1.0:1788850878.104339:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608320 00000100:00100000:1.0:1788850878.104358:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788850878.104363:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002096f2b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+11:5842:x1875746019608320:12345-0@lo:501: 00000100:00100000:1.0:1788850878.105332:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002096f2b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+11:5842:x1875746019608320:12345-0@lo:501: Request processed in 966us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850878.105343:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788850878.105483:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000088cdf5a8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019608320:0@lo:501: 00000100:00100000:2.0:1788850878.105519:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f56c31ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019608448:0@lo:503: 00000100:00100000:2.0:1788850878.105622:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850878.105692:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 000000002cac9326 going to sleep for 11 seconds 00000100:00100000:3.0:1788850878.105729:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608448 00000100:00100000:3.0:1788850878.105734:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608448 00000100:00100000:3.0:1788850878.105944:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788850878.105952:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000080842a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+11:5842:x1875746019608448:12345-0@lo:503: 00000040:00080000:3.0:1788850878.106000:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788850878.106052:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000080842a35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+11:5842:x1875746019608448:12345-0@lo:503: Request processed in 101us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850878.106059:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788850878.106143:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f56c31ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019608448:0@lo:503: 00000040:00080000:2.0:1788850878.106992:0:5888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788850878.107357:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788850878.107375:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788850878.107395:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 000000000cc7a39d/0x7ad3e1a8795768ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795768f5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850878.107406:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 000000000cc7a39d/0x7ad3e1a8795768ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795768f5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850878.107448:0:5842:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788850878.107451:0:5842:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a9ba0462000 10000000:01000000:0.0:1788850878.107454:0:5842:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a9ba0462000 10000000:01000000:0.0:1788850878.107458:0:5842:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788850878.107463:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a9ba0462000 from 1 10000000:01000000:0.0:1788850878.107465:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788850878.107513:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000e4dcb243/0x7ad3e1a8795768fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850878.107533:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000e4dcb243/0x7ad3e1a8795768fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850878.107542:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000e4dcb243/0x7ad3e1a8795768fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850878.107564:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000018944105 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019608576:0@lo:101: 00000100:00100000:0.0:1788850878.107613:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850878.107653:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 000000008a0054c7 going to sleep for 11 seconds 00000100:00100000:2.0:1788850878.107755:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608576 00000100:00100000:2.0:1788850878.107761:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608576 00000100:00100000:2.0:1788850878.107831:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788850878.107850:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005167c15e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+11:5842:x1875746019608576:12345-0@lo:101: 00010000:00010000:2.0:1788850878.107861:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850878.107874:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008576fbba/0x7ad3e1a879576903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a8795768fc expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850878.107894:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008576fbba/0x7ad3e1a879576903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a8795768fc expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850878.107904:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008576fbba/0x7ad3e1a879576903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a8795768fc expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850878.107923:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008576fbba, rc 0) 00000100:00100000:2.0:1788850878.107963:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005167c15e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5842:x1875746019608576:12345-0@lo:101: Request processed in 115us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850878.107970:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788850878.108014:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000018944105 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019608576:0@lo:101: 00010000:00010000:2.0:1788850878.108026:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000e4dcb243/0x7ad3e1a8795768fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576903 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850878.108034:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000e4dcb243/0x7ad3e1a8795768fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576903 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850878.108093:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f56c31ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019608704:0@lo:501: 00000100:00100000:2.0:1788850878.108121:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850878.108136:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f342abc1 going to sleep for 11 seconds 00000100:00100000:2.0:1788850878.108148:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608704 00000100:00100000:2.0:1788850878.108151:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608704 00000100:00100000:2.0:1788850878.108168:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788850878.108173:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c51a049c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5842:x1875746019608704:12345-0@lo:501: 00000100:00100000:2.0:1788850878.108410:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c51a049c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5842:x1875746019608704:12345-0@lo:501: Request processed in 237us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850878.108417:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788850878.108443:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f56c31ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019608704:0@lo:501: 00000100:00100000:2.0:1788850878.108464:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f56c31ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019608832:0@lo:503: 00000100:00100000:2.0:1788850878.108495:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850878.108505:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f342abc1 going to sleep for 11 seconds 00000100:00100000:2.0:1788850878.108521:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608832 00000100:00100000:2.0:1788850878.108537:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608832 00000100:00100000:2.0:1788850878.108551:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788850878.108556:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bf6466f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5842:x1875746019608832:12345-0@lo:503: 00000100:00100000:2.0:1788850878.108850:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bf6466f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5842:x1875746019608832:12345-0@lo:503: Request processed in 294us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850878.108856:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788850878.108888:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f56c31ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019608832:0@lo:503: 00000100:00100000:3.0:1788850878.109643:0:5889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000152d3e6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:5889:1875746019608960:0@lo:502: 00000100:00100000:3.0:1788850878.109686:0:5889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850878.109741:0:5889:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fd371218 going to sleep for 11 seconds 00000100:00100000:2.0:1788850878.109775:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019608960 00000100:00100000:2.0:1788850878.109924:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019608960 00000100:00100000:2.0:1788850878.109998:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788850878.110005:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009aa6f6b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5889:x1875746019608960:12345-0@lo:502: 00000100:00100000:2.0:1788850878.110236:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009aa6f6b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5889:x1875746019608960:12345-0@lo:502: Request processed in 232us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850878.110243:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788850878.110313:0:5889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000152d3e6a pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:5889:1875746019608960:0@lo:502: 00000020:01000004:3.0:1788850878.110364:0:5889:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788850878.110380:0:5889:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000021ec9f26) 00000020:00000080:3.0:1788850878.110399:0:5889:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788850878.110484:0:5889:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a1f74745 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788850878.110488:0:5889:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000a1f74745 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788850878.110490:0:5889:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000a1f74745 4 00010000:00080000:3.0:1788850878.110521:0:5889:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000999591a@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.106@tcp at head 00010000:00010000:3.0:1788850878.112406:0:5889:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788850878.112951:0:5889:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788850878.112997:0:5889:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788850878.113012:0:5889:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7ad3e1a879576911 00000100:00080000:3.0:1788850878.113026:0:5889:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788850878.113038:0:5889:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000999591a using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1788850878.113108:0:5889:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000152d3e6a x1875746019609088/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788850878.113132:0:5889:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788850878.113278:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000152d3e6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875746019609088:0@lo:38: 00000100:00100000:0.0:1788850878.113355:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850878.113418:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609088 00000100:00100000:0.0:1788850878.113426:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609088 00000100:00100000:0.0:1788850878.113456:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788850878.113462:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bd655473 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875746019609088:12345-0@lo:38: 00000100:00100000:0.0:1788850878.113507:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bd655473 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875746019609088:12345-0@lo:38: Request processed in 44us (152us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788850878.113513:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788850878.113616:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788850878.113624:0:3307:0:(import.c:65:import_set_state_nolock()) 000000000999591a lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788850878.113628:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788850878.113631:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000152d3e6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875746019609088:0@lo:38: 00000100:00100000:2.0:1788850878.116310:0:5889:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f56c31ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:5889:1875746019609216:0@lo:502: 00000100:00100000:2.0:1788850878.116399:0:5889:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850878.116437:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609216 00000100:00100000:2.0:1788850878.116444:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609216 00000100:00100000:2.0:1788850878.116492:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788850878.116500:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000071e05f4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5889:x1875746019609216:12345-0@lo:502: 00000100:00100000:2.0:1788850878.116940:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000071e05f4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5889:x1875746019609216:12345-0@lo:502: Request processed in 439us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850878.116948:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788850878.117002:0:5889:0:(client.c:2716:ptlrpc_set_wait()) set 000000000ffa8767 going to sleep for 11 seconds 00000100:00100000:2.0:1788850878.117025:0:5889:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f56c31ab pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:5889:1875746019609216:0@lo:502: 00000040:00080000:2.0:1788850878.117062:0:5889:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788850878.118153:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788850878.118177:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788850878.118197:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000e4dcb243/0x7ad3e1a8795768fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576903 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850878.118210:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000e4dcb243/0x7ad3e1a8795768fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576903 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788850878.118258:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788850878.118261:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788850878.118262:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788850878.118264:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788850878.118265:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788850878.118266:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788850878.118268:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788850878.118269:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788850878.118271:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788850878.118272:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788850878.118274:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788850878.118280:0:5842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788850878.118285:0:5842:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788850878.118287:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788850878.118288:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788850878.118289:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788850878.118290:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788850878.118290:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788850878.118291:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788850878.118292:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788850878.118293:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788850878.118294:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788850878.118294:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788850878.118295:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788850878.118296:0:5842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788850878.118333:0:5842:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788850878.118349:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000066a449f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019609344:0@lo:253: 00000100:00100000:0.0:1788850878.118406:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850878.118446:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ac951ad5 going to sleep for 11 seconds 00000100:00100000:3.0:1788850878.118497:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609344 00000100:00100000:3.0:1788850878.118504:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609344 00000100:00100000:3.0:1788850878.118561:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788850878.118569:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b26c817a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5842:x1875746019609344:12345-0@lo:253: 20000000:01000000:3.0:1788850878.118601:0:5856:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788850878.118615:0:5856:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788850878.152061:0:5856:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788850878.152095:0:5856:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788850878.152152:0:5877:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788850878.152158:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788850878.152181:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000047a832ad/0x7ad3e1a879576918 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850878.152201:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fc424c4b/0x7ad3e1a8795768e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a8795768e0 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850878.152223:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000047a832ad/0x7ad3e1a879576918 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850878.152265:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fc424c4b/0x7ad3e1a8795768e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a8795768e0 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850878.152279:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fc424c4b/0x7ad3e1a8795768e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a8795768e0 expref: 12 pid: 5853 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850878.152293:0:5877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e6a880e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1875746019609472:0@lo:104: 00000100:00100000:1.0:1788850878.152358:0:5877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850878.152419:0:5877:0:(client.c:2716:ptlrpc_set_wait()) set 000000009524baa6 going to sleep for 11 seconds 00000100:00100000:0.0:1788850878.152495:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609472 00000100:00100000:0.0:1788850878.152504:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609472 00000100:00100000:0.0:1788850878.152561:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788850878.152568:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dc2f98c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+3:5877:x1875746019609472:12345-0@lo:104: 00010000:00010000:0.0:1788850878.152584:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: 00000000386fbd6b/0x7ad3e1a8795768e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a8795768e7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850878.152634:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788850878.152639:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dc2f98c5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+3:5877:x1875746019609472:12345-0@lo:104: Request processed in 72us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850878.152645:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788850878.152663:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788850878.152668:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: 00000000386fbd6b/0x7ad3e1a8795768e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a8795768e7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850878.152682:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000386fbd6b already unused, calling callback (00000000a866cb84) 10000000:00010000:0.0:1788850878.152684:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: 00000000386fbd6b/0x7ad3e1a8795768e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a8795768e7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850878.152691:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: 00000000386fbd6b/0x7ad3e1a8795768e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a8795768e7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850878.152697:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: 00000000386fbd6b/0x7ad3e1a8795768e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a8795768e7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850878.152701:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850878.152728:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: 00000000386fbd6b/0x7ad3e1a8795768e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795768e7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850878.152734:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850878.152750:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: 00000000386fbd6b/0x7ad3e1a8795768e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795768e7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850878.152755:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: 00000000386fbd6b/0x7ad3e1a8795768e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795768e7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850878.152769:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850878.152771:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850878.152773:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850878.152866:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b71384b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019609600:0@lo:103: 00000100:00100000:0.0:1788850878.152894:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850878.153133:0:5877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e6a880e pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1875746019609472:0@lo:104: 00010000:00010000:1.0:1788850878.153154:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000047a832ad/0x7ad3e1a879576918 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850878.153218:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609600 00000100:00100000:3.0:1788850878.153223:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609600 00010000:00010000:3.0:1788850878.153243:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fc424c4b/0x7ad3e1a8795768e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a8795768e0 expref: 13 pid: 5853 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850878.153274:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788850878.153280:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b43733a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:3309:x1875746019609600:12345-0@lo:103: 00010000:00010000:3.0:1788850878.153290:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788850878.153300:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fc424c4b/0x7ad3e1a8795768e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a8795768e0 expref: 13 pid: 5853 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850878.153310:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fc424c4b/0x7ad3e1a8795768e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a8795768e0 expref: 13 pid: 5853 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850878.153322:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fc424c4b/0x7ad3e1a8795768e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a8795768e0 expref: 13 pid: 5853 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850878.153335:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000047a832ad/0x7ad3e1a879576918 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850878.153342:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000047a832ad/0x7ad3e1a879576918 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788850878.153355:0:5846:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001199443s 00010000:00010000:3.0:1788850878.153359:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000047a832ad/0x7ad3e1a879576918 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850878.153365:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000047a832ad/0x7ad3e1a879576918 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850878.153370:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000047a832ad/0x7ad3e1a879576918 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850878.153375:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000047a832ad/0x7ad3e1a879576918 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850878.153380:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000047a832ad already unused, calling callback (000000002a9799c3) 00010000:00010000:3.0:1788850878.153383:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000047a832ad/0x7ad3e1a879576918 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850878.153388:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000047a832ad/0x7ad3e1a879576918 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850878.153413:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000047a832ad/0x7ad3e1a879576918 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850878.153424:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850878.153458:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b43733a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:3309:x1875746019609600:12345-0@lo:103: Request processed in 179us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850878.153465:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788850878.153505:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b71384b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019609600:0@lo:103: 00010000:00010000:1.0:1788850878.153597:0:5877:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000047a832ad/0x7ad3e1a879576918 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850878.153604:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000047a832ad/0x7ad3e1a879576918 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850878.153610:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000047a832ad/0x7ad3e1a879576918 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850878.158748:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b26c817a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+11:5842:x1875746019609344:12345-0@lo:253: Request processed in 40168us (40331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850878.158767:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788850878.159071:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000066a449f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:5842:1875746019609344:0@lo:253: 10000000:01000000:2.0:1788850878.159098:0:5842:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788850878.159102:0:5842:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788850878.159104:0:5842:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788850878.159105:0:5842:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788850878.159106:0:5842:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788850878.159107:0:5842:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788850878.159108:0:5842:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788850878.159110:0:5842:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788850878.159111:0:5842:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788850878.159113:0:5842:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788850878.159114:0:5842:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788850878.159115:0:5842:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788850878.159117:0:5842:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788850878.159132:0:5842:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788850878.165516:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788850878.166157:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788850878.166379:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788850878.166629:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788850878.167063:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788850878.167285:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1788850878.168222:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1788850878.168394:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1788850878.168620:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1788850878.168803:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1788850878.169106:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1788850878.169287:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788850878.209503:0:5842:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00010000:00010000:1.0:1788850878.227500:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788850878.239221:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788850878.239501:0:5895:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1788850878.243633:0:5894:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788850878.243640:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788850878.244347:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788850878.244685:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788850878.245236:0:5842:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788850878.245244:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788850878.245370:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788850878.246854:0:5842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788850878.247525:0:5842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788850878.247556:0:5842:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788850878.247767:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788850878.248596:0:5842:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1788850878.250244:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788850878.250377:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788850878.250532:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788850878.250679:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788850878.251054:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788850878.251199:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788850878.251338:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788850878.251465:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788850878.251685:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788850878.251995:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788850878.252168:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788850878.252312:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788850878.252458:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788850878.256055:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788850878.256278:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788850878.256455:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788850878.264429:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788850878.264626:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788850878.264837:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788850878.264989:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788850878.265159:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788850878.265307:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788850878.265443:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788850878.265589:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788850878.265721:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788850878.265920:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788850878.266087:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788850878.268332:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788850878.268653:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788850878.268919:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788850878.269062:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788850878.269242:0:5842:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788850878.269442:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788850878.298760:0:5895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788850878.420129:0:5842:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788850878.420168:0:5842:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff970841cc3988 00100000:10000000:3.0:1788850878.420176:0:5842:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788850878.427513:0:5842:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788850878.427543:0:5842:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788850878.427557:0:5842:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788850878.427576:0:5842:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1788850878.465628:0:5895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788850878.465714:0:5895:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788850878.465719:0:5895:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788850879.251820:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850880.274572:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850881.298154:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850882.322028:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788850882.656639:0:6138:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788850883.348999:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788850883.601886:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788850883.601896:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788850883.601899:0:38:0:(import.c:65:import_set_state_nolock()) 000000000999591a lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788850883.601915:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000000999591a using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1788850883.601936:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b96cfbb4 x1875746019609856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788850883.601996:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b96cfbb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875746019609856:0@lo:38: 00000100:00100000:3.0:1788850883.602127:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850883.603536:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609856 00000100:00100000:0.0:1788850883.603547:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609856 00000100:00100000:0.0:1788850883.603583:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788850883.603589:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000385e1537 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875746019609856:12345-0@lo:38: 00010000:00080000:0.0:1788850883.603615:0:5863:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:0.0:1788850883.603652:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7ad3e1a87957691f 00000004:00100000:0.0:1788850883.603724:0:5863:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788850883.603864:0:5863:0:(import.c:65:import_set_state_nolock()) 00000000136e10d5 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788850883.603935:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000385e1537 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875746019609856:12345-0@lo:38: Request processed in 345us (1808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850883.603942:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:0.0:1788850883.603985:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788850883.603989:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a9ba0462000 from 3 10000000:01000000:0.0:1788850883.603992:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788850883.604019:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 00000000a4d1c289/0x7ad3e1a879576926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850883.604128:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 00000000a4d1c289/0x7ad3e1a879576926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850883.604137:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 00000000a4d1c289/0x7ad3e1a879576926 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850883.604154:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047219dbd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019609984:0@lo:101: 00000100:00100000:0.0:1788850883.604187:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850883.604608:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007bbea7ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019609728:0@lo:400: 00000100:00100000:1.0:1788850883.604638:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850883.604701:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609984 00000100:00100000:2.0:1788850883.604707:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609984 00000100:00100000:2.0:1788850883.604733:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019609728 00000100:00100000:2.0:1788850883.604735:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019609728 00000100:00100000:2.0:1788850883.604745:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788850883.604750:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e068d968 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5858:x1875746019609984:12345-0@lo:101: 00010000:00010000:2.0:1788850883.604760:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850883.604773:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000505d2bae/0x7ad3e1a87957692d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576926 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.604810:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000505d2bae/0x7ad3e1a87957692d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576926 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.604819:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000505d2bae/0x7ad3e1a87957692d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576926 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850883.604839:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000505d2bae, rc 0) 00000100:00100000:2.0:1788850883.604864:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e068d968 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:5858:x1875746019609984:12345-0@lo:101: Request processed in 113us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850883.604869:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788850883.604889:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788850883.604894:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e4055762 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:3310:x1875746019609728:12345-0@lo:400: 00000100:00100000:2.0:1788850883.604912:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e4055762 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:3310:x1875746019609728:12345-0@lo:400: Request processed in 19us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850883.604918:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788850883.605415:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b96cfbb4 x1875746019609856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788850893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788850883.605445:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788850883.605452:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788850883.605456:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788850883.605459:0:3307:0:(import.c:65:import_set_state_nolock()) 000000000999591a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788850883.605465:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b96cfbb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875746019609856:0@lo:38: 00000100:00100000:0.0:1788850883.605961:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4e570c3 going to sleep for 11 seconds 00000100:00100000:0.0:1788850883.605987:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047219dbd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019609984:0@lo:101: 00010000:00010000:0.0:1788850883.606003:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 00000000a4d1c289/0x7ad3e1a879576926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a87957692d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850883.606013:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 00000000a4d1c289/0x7ad3e1a879576926 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a87957692d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850883.608843:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000047219dbd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019610112:0@lo:256: 00000100:00100000:0.0:1788850883.608916:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850883.608953:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4e570c3 going to sleep for 11 seconds 00000100:00100000:3.0:1788850883.610390:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019610112 00000100:00100000:3.0:1788850883.610401:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019610112 00000100:00100000:3.0:1788850883.610453:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788850883.610460:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002503ec16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5858:x1875746019610112:12345-0@lo:256: 20000000:01000000:3.0:1788850883.610482:0:5853:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788850883.610496:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788850883.610499:0:5853:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788850883.610591:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002503ec16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5858:x1875746019610112:12345-0@lo:256: Request processed in 132us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850883.610599:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788850883.610694:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000047219dbd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019610112:0@lo:256: 10000000:01000000:3.0:1788850883.610734:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788850883.610740:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: 00000000a4d1c289/0x7ad3e1a879576926 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a87957692d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850883.610751:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: 00000000a4d1c289/0x7ad3e1a879576926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a87957692d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850883.613655:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007bbea7ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019609728:0@lo:400: 00010000:00010000:3.0:1788850884.370093:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850885.394056:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850886.421496:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850887.445456:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788850887.487278:0:6340:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1fafa3e0 20000000:00000080:0.0:1788850887.487298:0:6340:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a9b8bc7f000 uarg=0000000000000000 20000000:01000000:0.0:1788850887.487330:0:6340:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788850887.487411:0:6340:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788850887.487417:0:6340:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788850887.487608:0:6340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788850887.487620:0:6340:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788850887.493531:0:6340:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788850887.493972:0:6340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788850887.494427:0:6340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788850887.494490:0:6340:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788850887.494508:0:6340:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788850887.494527:0:6340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000eb1241ae/0x7ad3e1a879576934 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.494548:0:6340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fced8b82/0x7ad3e1a8795768f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a8795768ee expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.494556:0:6340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000eb1241ae/0x7ad3e1a879576934 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.494595:0:6340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fced8b82/0x7ad3e1a8795768f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a8795768ee expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.494612:0:6340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fced8b82/0x7ad3e1a8795768f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a8795768ee expref: 11 pid: 5855 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850887.494625:0:6340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ec8cc51f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6340:1875746019610240:0@lo:104: 00000100:00100000:0.0:1788850887.494691:0:6340:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850887.494917:0:6340:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9b25021 going to sleep for 11 seconds 00000100:00100000:1.0:1788850887.496646:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019610240 00000100:00100000:1.0:1788850887.496661:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019610240 00000100:00100000:1.0:1788850887.496719:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788850887.496729:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000037e8b782 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+3:6340:x1875746019610240:12345-0@lo:104: 00010000:00010000:1.0:1788850887.496747:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: 000000000cc7a39d/0x7ad3e1a8795768ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a8795768f5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850887.496874:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788850887.496908:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000037e8b782 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+3:6340:x1875746019610240:12345-0@lo:104: Request processed in 166us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850887.496916:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788850887.496940:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788850887.496945:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: 000000000cc7a39d/0x7ad3e1a8795768ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a8795768f5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850887.496952:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000cc7a39d already unused, calling callback (00000000a866cb84) 10000000:00010000:1.0:1788850887.496955:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: 000000000cc7a39d/0x7ad3e1a8795768ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a8795768f5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850887.496963:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: 000000000cc7a39d/0x7ad3e1a8795768ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a8795768f5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788850887.496970:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: 000000000cc7a39d/0x7ad3e1a8795768ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a8795768f5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850887.496976:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788850887.497010:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: 000000000cc7a39d/0x7ad3e1a8795768ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795768f5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850887.497017:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788850887.497485:0:6340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ec8cc51f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6340:1875746019610240:0@lo:104: 00010000:00010000:2.0:1788850887.497516:0:6340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000eb1241ae/0x7ad3e1a879576934 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850887.497606:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788850887.497625:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: 000000000cc7a39d/0x7ad3e1a8795768ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795768f5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850887.497633:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: 000000000cc7a39d/0x7ad3e1a8795768ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795768f5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850887.497651:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850887.497654:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850887.497655:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850887.498462:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e6a880e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019610368:0@lo:103: 00000100:00100000:2.0:1788850887.498517:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850887.498654:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019610368 00000100:00100000:0.0:1788850887.498662:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019610368 00010000:00010000:0.0:1788850887.498694:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fced8b82/0x7ad3e1a8795768f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a8795768ee expref: 12 pid: 5855 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850887.498742:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788850887.498750:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f56c31ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:3310:x1875746019610368:12345-0@lo:103: 00010000:00010000:0.0:1788850887.498764:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850887.498769:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fced8b82/0x7ad3e1a8795768f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a8795768ee expref: 12 pid: 5855 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.498801:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fced8b82/0x7ad3e1a8795768f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a8795768ee expref: 12 pid: 5855 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.498818:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fced8b82/0x7ad3e1a8795768f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a8795768ee expref: 12 pid: 5855 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.498844:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000eb1241ae/0x7ad3e1a879576934 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.498851:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb1241ae/0x7ad3e1a879576934 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.498867:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eb1241ae/0x7ad3e1a879576934 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.498873:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000eb1241ae/0x7ad3e1a879576934 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.498880:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000eb1241ae/0x7ad3e1a879576934 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.498885:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000eb1241ae/0x7ad3e1a879576934 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.498911:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eb1241ae already unused, calling callback (000000002a9799c3) 00010000:00010000:0.0:1788850887.498915:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000eb1241ae/0x7ad3e1a879576934 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.498922:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000eb1241ae/0x7ad3e1a879576934 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.498934:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000eb1241ae/0x7ad3e1a879576934 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850887.498944:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850887.498980:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f56c31ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+11:3310:x1875746019610368:12345-0@lo:103: Request processed in 232us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850887.498987:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788850887.499021:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e6a880e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019610368:0@lo:103: 00010000:00010000:2.0:1788850887.499291:0:6340:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000eb1241ae/0x7ad3e1a879576934 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850887.499299:0:6340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000eb1241ae/0x7ad3e1a879576934 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850887.499304:0:6340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eb1241ae/0x7ad3e1a879576934 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850888.466282:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850888.724969:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008af49bc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019610624:0@lo:400: 00000100:00100000:1.0:1788850888.725059:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850888.725141:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000020174c74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019610496:0@lo:400: 00000100:00100000:0.0:1788850888.725177:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850888.727087:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019610624 00000100:00100000:1.0:1788850888.727101:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019610624 00000100:00100000:1.0:1788850888.727146:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788850888.727154:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c4bae56b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019610624:12345-0@lo:400: 00000100:00100000:1.0:1788850888.727228:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c4bae56b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019610624:12345-0@lo:400: Request processed in 76us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850888.727235:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788850888.727272:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008af49bc2 x1875746019610624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850888.727286:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008af49bc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019610624:0@lo:400: 00000100:00100000:0.0:1788850888.727835:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019610496 00000100:00100000:0.0:1788850888.727842:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019610496 00000100:00100000:0.0:1788850888.727884:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788850888.727890:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009fafa361 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+11:3308:x1875746019610496:12345-0@lo:400: 00000100:00100000:0.0:1788850888.727944:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009fafa361 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+11:3308:x1875746019610496:12345-0@lo:400: Request processed in 55us (2767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850888.727950:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788850888.728251:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000020174c74 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019610496:0@lo:400: 00010000:00010000:1.0:1788850889.490488:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850890.514083:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850891.543659:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850892.566172:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788850892.820231:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788850892.820304:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9ba0462000 from 1 10000000:01000000:0.0:1788850892.820309:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788850892.820380:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: 0000000001a7c180/0x7ad3e1a87957693b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850892.820394:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: 0000000001a7c180/0x7ad3e1a87957693b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850892.820407:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: 0000000001a7c180/0x7ad3e1a87957693b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850892.820436:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e62440ad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019610752:0@lo:101: 00000100:00100000:0.0:1788850892.820535:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850892.820604:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1aae09b going to sleep for 11 seconds 00000100:00100000:2.0:1788850892.820810:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019610752 00000100:00100000:2.0:1788850892.820821:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019610752 00000100:00100000:2.0:1788850892.820889:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788850892.820899:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c8a19c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+11:5858:x1875746019610752:12345-0@lo:101: 00010000:00010000:2.0:1788850892.820916:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850892.820945:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f7db35bb/0x7ad3e1a879576942 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a87957693b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850892.820973:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f7db35bb/0x7ad3e1a879576942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a87957693b expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850892.820983:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f7db35bb/0x7ad3e1a879576942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a87957693b expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850892.820992:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f7db35bb, rc 0) 00000100:00100000:2.0:1788850892.821042:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c8a19c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5858:x1875746019610752:12345-0@lo:101: Request processed in 145us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850892.821049:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788850892.821362:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e62440ad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019610752:0@lo:101: 00010000:00010000:0.0:1788850892.821381:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: 0000000001a7c180/0x7ad3e1a87957693b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576942 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850892.821390:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: 0000000001a7c180/0x7ad3e1a87957693b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576942 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850892.821452:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e62440ad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019610880:0@lo:501: 00000100:00100000:0.0:1788850892.821482:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850892.821506:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1aae09b going to sleep for 11 seconds 00000100:00100000:0.0:1788850892.821520:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019610880 00000100:00100000:0.0:1788850892.821523:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019610880 00000100:00100000:0.0:1788850892.821545:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788850892.821551:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aeed4c36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5858:x1875746019610880:12345-0@lo:501: 00000100:00100000:0.0:1788850892.823166:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aeed4c36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5858:x1875746019610880:12345-0@lo:501: Request processed in 1607us (1675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850892.823181:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788850892.823359:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e62440ad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019610880:0@lo:501: 00000100:00100000:0.0:1788850892.823420:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e62440ad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019611008:0@lo:503: 00000100:00100000:0.0:1788850892.823488:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850892.823556:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d1aae09b going to sleep for 11 seconds 00000100:00100000:2.0:1788850892.827313:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611008 00000100:00100000:2.0:1788850892.827338:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611008 00000100:00100000:2.0:1788850892.827452:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788850892.827463:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000abf19d17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5858:x1875746019611008:12345-0@lo:503: 00000100:00100000:2.0:1788850892.828072:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000abf19d17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5858:x1875746019611008:12345-0@lo:503: Request processed in 609us (4582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850892.828084:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788850892.830867:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e62440ad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019611008:0@lo:503: 00000100:00100000:2.0:1788850892.831520:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000034c33820 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:6673:1875746019611136:0@lo:502: 00000100:00100000:2.0:1788850892.831623:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850892.831691:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d644a6bc going to sleep for 11 seconds 00000100:00100000:0.0:1788850892.831824:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611136 00000100:00100000:0.0:1788850892.831834:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611136 00000100:00100000:0.0:1788850892.831886:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788850892.831896:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b257bae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6673:x1875746019611136:12345-0@lo:502: 00000100:00100000:0.0:1788850892.832513:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b257bae4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6673:x1875746019611136:12345-0@lo:502: Request processed in 616us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850892.832522:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788850892.835419:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000034c33820 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:6673:1875746019611136:0@lo:502: 00000020:01000000:2.0:1788850892.835505:0:6673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850892.835522:0:6673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850892.835526:0:6673:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788850892.835539:0:6673:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a9ba0462000 00000020:00000080:2.0:1788850892.835543:0:6673:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788850892.835625:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d76d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:6673:1875746019611264:0@lo:502: 00000100:00100000:2.0:1788850892.835726:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850892.837196:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87cac480 going to sleep for 11 seconds 00000100:00100000:0.0:1788850892.837830:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611264 00000100:00100000:0.0:1788850892.837843:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611264 00000100:00100000:2.0:1788850892.838128:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788850892.838141:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6673:x1875746019611264:12345-0@lo:502: 00000100:00100000:2.0:1788850892.840342:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6673:x1875746019611264:12345-0@lo:502: Request processed in 2190us (4603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850892.840358:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788850892.840469:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d76d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:6673:1875746019611264:0@lo:502: 00000020:01000000:2.0:1788850892.840516:0:6673:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850892.840527:0:6673:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850892.840529:0:6673:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788850892.840537:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788850892.840908:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788850892.841009:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788850892.841022:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7600/0x7ad3e1a87957693b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576942 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850892.841035:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7600/0x7ad3e1a87957693b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576942 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850893.586739:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788850893.716043:0:6702:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788850893.716049:0:6702:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788850893.716208:0:6702:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a9ba049f800 00000020:01000004:0.0:1788850893.717374:0:6702:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788850893.717394:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788850893.717420:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a9b90474d40) 00000020:00000080:0.0:1788850893.717443:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788850893.738048:0:6702:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788850893.738473:0:6702:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788850893.776185:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788850893.788323:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788850893.788365:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788850893.788442:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788850893.788498:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788850893.790127:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788850893.790159:0:6702:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788850893.790179:0:6702:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7ad3e1a879576950 00000020:01000004:2.0:1788850893.790196:0:6702:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788850893.790843:0:6702:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788850893.790850:0:6702:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788850893.790860:0:6702:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788850893.790866:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788850893.790886:0:6702:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a9ba0413380) 00000020:00000080:2.0:1788850893.790904:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788850893.795375:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788850893.795664:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788850893.795672:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788850893.798961:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788850893.798980:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788850893.816191:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788850893.816209:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788850893.828489:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788850893.830359:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788850893.830372:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788850893.841551:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788850893.841583:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788850893.844405:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019611392:0@lo:400: 00000100:00100000:0.0:1788850893.844511:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850893.844604:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788850893.844611:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019611520:0@lo:400: 00000100:00100000:0.0:1788850893.844644:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850893.844701:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611392 00000100:00100000:0.0:1788850893.844712:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611392 00000100:00100000:0.0:1788850893.844767:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788850893.844824:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+12:3310:x1875746019611392:12345-0@lo:400: 00000100:00100000:0.0:1788850893.844887:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+12:3310:x1875746019611392:12345-0@lo:400: Request processed in 65us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850893.844896:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788850893.844937:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611520 00000100:00100000:0.0:1788850893.844941:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611520 00000100:00100000:0.0:1788850893.844972:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788850893.844978:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019611520:12345-0@lo:400: 00000100:00100000:0.0:1788850893.845012:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019611520:12345-0@lo:400: Request processed in 34us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850893.845019:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788850893.845070:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a9b99171f80 x1875746019611520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850893.845088:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019611520:0@lo:400: 00000100:00100000:0.0:1788850893.845100:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019611392:0@lo:400: 00000100:00100000:2.0:1788850893.884034:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788850893.884442:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788850893.884450:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788850893.886552:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788850893.886571:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788850893.887430:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788850893.887440:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788850893.890503:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788850893.890965:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788850893.890975:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788850893.891704:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788850893.891715:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788850893.943518:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788850893.944239:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788850893.944254:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788850893.949441:0:6702:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788850893.949463:0:6702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788850893.950461:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788850893.950496:0:6702:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788850893.952373:0:6702:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788850893.976318:0:6702:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788850893.976369:0:6702:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.106@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788850893.976375:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788850893.976377:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788850893.976378:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788850893.976380:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788850893.976381:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788850893.976382:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788850893.976384:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788850893.976385:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788850893.976386:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788850893.976388:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788850893.976389:0:6702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788850893.976393:0:6702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788850893.976395:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788850893.976399:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788850893.976400:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788850893.976401:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788850893.976402:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788850893.976403:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788850893.976404:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788850893.976404:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788850893.976405:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788850893.976406:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788850893.976407:0:6702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788850893.976443:0:6702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788850893.976466:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019611648:0@lo:253: 00000100:00100000:0.0:1788850893.976566:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850893.976858:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c093c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850893.977071:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611648 00000100:00100000:3.0:1788850893.977081:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611648 00000100:00100000:3.0:1788850893.977141:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788850893.977153:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6702:x1875746019611648:12345-0@lo:253: 20000000:01000000:3.0:1788850893.977194:0:5853:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788850893.977199:0:5853:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788850893.977205:0:5853:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788850893.977209:0:5853:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788850893.978627:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788850893.978952:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788850893.978969:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788850893.979015:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788850893.979024:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788850893.979057:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788850893.979108:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788850893.979549:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788850893.979578:0:5853:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.106@tcp 20000000:01000000:3.0:1788850893.979580:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.106@tcp (null) (null) (null) 00000040:00080000:3.0:1788850893.979624:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788850893.979632:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788850893.979692:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788850893.979701:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.106@tcp (null) (null) 00000040:00080000:3.0:1788850893.979734:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788850893.979744:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788850893.979836:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788850893.979894:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788850893.981299:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788850893.981335:0:5853:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.106@tcp 20000000:01000000:3.0:1788850893.981338:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.106@tcp (null) (null) (null) 00000040:00080000:3.0:1788850893.981374:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788850893.981382:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788850893.981418:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788850893.981426:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.106@tcp (null) (null) 00000040:00080000:3.0:1788850893.981470:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788850893.981481:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788850893.981510:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788850893.981541:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788850893.981560:0:5853:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1788850893.981564:0:5853:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1788850893.981572:0:5853:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788850893.981574:0:5853:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788850893.981576:0:5853:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788850893.981593:0:5853:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788850893.981596:0:5853:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788850893.981705:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788850893.981709:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788850893.982493:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788850893.983270:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788850893.983321:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788850893.983412:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788850893.983431:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788850893.983433:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788850893.984276:0:6719:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788850893.984349:0:6719:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788850893.984398:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788850893.987028:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788850893.987102:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788850893.987289:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788850893.987308:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788850893.987312:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788850893.988249:0:6720:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788850893.988316:0:6720:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788850893.988380:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788850893.988694:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788850893.988728:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788850893.989033:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:0.0:1788850893.989057:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788850893.989083:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9b98af6800/0x7ad3e1a87957695e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850893.989106:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a879576877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576870 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850893.989114:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b98af6a00/0x7ad3e1a879576893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a87957688c expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850893.989130:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a8795768fc expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850893.989138:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9b98af6800/0x7ad3e1a87957695e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850893.989192:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a8795768fc expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850893.989209:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576903 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a8795768fc expref: 12 pid: 5856 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850893.989227:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019611776:0@lo:104: 00000100:00100000:0.0:1788850893.989315:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788850893.989425:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b98af6a00/0x7ad3e1a879576893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a87957688c expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850893.989434:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b98af6a00/0x7ad3e1a879576893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a87957688c expref: 12 pid: 5856 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850893.989442:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99172d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019611904:0@lo:104: 00000100:00100000:0.0:1788850893.989465:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788850893.992295:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a879576877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576870 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850893.992319:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a879576877 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576870 expref: 12 pid: 5853 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850893.992341:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019612032:0@lo:104: 00000100:00100000:3.0:1788850893.992345:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611776 00000100:00100000:3.0:1788850893.992357:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611776 00000100:00100000:3.0:1788850893.992410:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019611904 00000100:00100000:3.0:1788850893.992420:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019611904 00000100:00100000:0.0:1788850893.992429:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850893.992433:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612032 00000100:00100000:3.0:1788850893.992435:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612032 00000100:00100000:0.0:1788850893.992442:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b985740c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850893.992447:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788850893.992456:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99173480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+5:5853:x1875746019611776:12345-0@lo:104: 00010000:00010000:3.0:1788850893.992471:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a8795768fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576903 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850893.992598:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788850893.992606:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99173480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+5:5853:x1875746019611776:12345-0@lo:104: Request processed in 151us (3291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850893.992613:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788850893.992639:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788850893.992646:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+4:5853:x1875746019611904:12345-0@lo:104: 00010000:00010000:3.0:1788850893.992654:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a87957688c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576893 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850893.992741:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019611776:0@lo:104: 00000100:00100000:0.0:1788850893.992750:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99172d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019611904:0@lo:104: 00010000:00010000:2.0:1788850893.993048:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788850893.993127:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788850893.993134:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99172a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+4:5853:x1875746019611904:12345-0@lo:104: Request processed in 488us (3667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850893.993141:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788850893.993156:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788850893.993164:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+3:5853:x1875746019612032:12345-0@lo:104: 00010000:00010000:3.0:1788850893.993172:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5a00/0x7ad3e1a879576870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576877 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850893.993258:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019612032:0@lo:104: 00010000:00010000:1.0:1788850893.993292:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9b98af6800/0x7ad3e1a87957695e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995337:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a8795768fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576903 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995360:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7000 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:2.0:1788850893.995366:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a8795768fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576903 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995379:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a8795768fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576903 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788850893.995388:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a8795768fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576903 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850893.995394:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788850893.995469:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a8795768fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576903 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995477:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788850893.995539:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a8795768fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576903 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995548:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a8795768fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576903 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995569:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788850893.995573:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a87957688c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576893 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995579:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4000 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:2.0:1788850893.995582:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a87957688c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576893 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995589:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a87957688c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576893 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850893.995595:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019612160:0@lo:103: 10000000:00010000:2.0:1788850893.995597:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a87957688c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576893 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850893.995602:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788850893.995622:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a87957688c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576893 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995627:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788850893.995632:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a87957688c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576893 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995639:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a87957688c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576893 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995648:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788850893.995658:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5a00/0x7ad3e1a879576870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576877 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995664:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5a00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:2.0:1788850893.995669:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5a00/0x7ad3e1a879576870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576877 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995678:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5a00/0x7ad3e1a879576870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576877 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788850893.995683:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5a00/0x7ad3e1a879576870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576877 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850893.995683:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788850893.995689:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788850893.995705:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5a00/0x7ad3e1a879576870 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576877 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995711:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788850893.995730:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5a00/0x7ad3e1a879576870 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576877 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995737:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5a00/0x7ad3e1a879576870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576877 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.995754:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850893.995756:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850893.995762:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788850893.995795:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788850893.995808:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+3:5853:x1875746019612032:12345-0@lo:104: Request processed in 2643us (3375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850893.995863:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788850893.995871:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019612288:0@lo:103: 00000100:00100000:1.0:1788850893.995896:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850893.995905:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788850893.995943:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612160 00000100:00100000:1.0:1788850893.995952:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612160 00010000:00010000:1.0:1788850893.995985:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576903 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a8795768fc expref: 13 pid: 5856 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850893.996011:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612288 00000100:00100000:1.0:1788850893.996014:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612288 00010000:00010000:1.0:1788850893.996024:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b98af6a00/0x7ad3e1a879576893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a87957688c expref: 14 pid: 5856 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850893.996036:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788850893.996044:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+14:3308:x1875746019612160:12345-0@lo:103: 00010000:00010000:0.0:1788850893.996053:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850893.996059:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788850893.996066:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576903 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a8795768fc expref: 14 pid: 5856 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850893.996078:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a8795768fc expref: 14 pid: 5856 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850893.996093:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a8795768fc expref: 14 pid: 5856 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850893.996108:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788850893.996120:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850893.996143:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019612416:0@lo:103: 00000100:00100000:2.0:1788850893.996231:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850893.996249:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:3308:x1875746019612160:12345-0@lo:103: Request processed in 203us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850893.996257:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788850893.996276:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612416 00000100:00100000:1.0:1788850893.996279:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612416 00000100:00100000:2.0:1788850893.996291:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788850893.996295:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a879576877 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576870 expref: 13 pid: 5853 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850893.996305:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:3308:x1875746019612288:12345-0@lo:103: 00000100:00100000:1.0:1788850893.996311:0:5846:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788850893.996322:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788850893.996328:0:5846:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788850893.996330:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b98af6a00/0x7ad3e1a879576893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a87957688c expref: 13 pid: 5856 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.996343:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b98af6a00/0x7ad3e1a879576893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a87957688c expref: 13 pid: 5856 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.996359:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af6a00/0x7ad3e1a879576893 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a87957688c expref: 13 pid: 5856 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.996373:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788850893.996399:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+12:3308:x1875746019612288:12345-0@lo:103: Request processed in 99us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850893.996406:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788850893.996421:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788850893.996428:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+11:3310:x1875746019612416:12345-0@lo:103: 00010000:00010000:2.0:1788850893.996436:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788850893.996441:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a879576877 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576870 expref: 11 pid: 5853 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.996452:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a879576877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576870 expref: 11 pid: 5853 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.996465:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a879576877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576870 expref: 11 pid: 5853 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.996480:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9b98af6800/0x7ad3e1a87957695e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.996490:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af6800/0x7ad3e1a87957695e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.996513:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b98af6800/0x7ad3e1a87957695e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.996589:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b98af6800/0x7ad3e1a87957695e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.996599:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9b98af6800/0x7ad3e1a87957695e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.996607:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9b98af6800/0x7ad3e1a87957695e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.996613:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6800 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788850893.996618:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9b98af6800/0x7ad3e1a87957695e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.996627:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9b98af6800/0x7ad3e1a87957695e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.996651:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9b98af6800/0x7ad3e1a87957695e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850893.996662:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788850893.996684:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9b98af6800/0x7ad3e1a87957695e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850893.996695:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+10:3310:x1875746019612416:12345-0@lo:103: Request processed in 267us (462us total) trans 0 rc 0/0 00010000:00010000:3.0:1788850893.996697:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9b98af6800/0x7ad3e1a87957695e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850893.996706:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788850893.996712:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af6800/0x7ad3e1a87957695e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788850893.996733:0:5853:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788850893.996753:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019612416:0@lo:103: 00000100:00100000:0.0:1788850893.998578:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019612288:0@lo:103: 00000100:00100000:0.0:1788850893.998599:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019612160:0@lo:103: 00000100:00100000:0.0:1788850894.065558:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+9:6702:x1875746019611648:12345-0@lo:253: Request processed in 88392us (88976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850894.065579:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788850894.065694:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019611648:0@lo:253: 10000000:01000000:2.0:1788850894.065715:0:6702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788850894.065740:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788850894.065742:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788850894.065744:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788850894.065746:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788850894.065747:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788850894.065749:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788850894.065750:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788850894.065752:0:6702:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788850894.065755:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788850894.065757:0:6702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788850894.065863:0:6702:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a9ba049f800 from lustre-OST0000 10000000:01000000:2.0:1788850894.065904:0:6702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788850894.065908:0:6702:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788850894.065918:0:6702:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a9b90470000 local copy 10000000:01000000:2.0:1788850894.065923:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788850894.065979:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3c00/0x7ad3e1a879576965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850894.065994:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3c00/0x7ad3e1a879576965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850894.066124:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3c00/0x7ad3e1a879576965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850894.066153:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019612544:0@lo:101: 00000100:00100000:2.0:1788850894.066206:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850894.066492:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788850894.066589:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612544 00000100:00100000:0.0:1788850894.066598:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612544 00000100:00100000:0.0:1788850894.067653:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788850894.067676:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+9:6702:x1875746019612544:12345-0@lo:101: 00010000:00010000:0.0:1788850894.067698:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850894.067724:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af6e00/0x7ad3e1a87957696c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576965 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850894.067758:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af6e00/0x7ad3e1a87957696c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576965 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850894.067799:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af6e00/0x7ad3e1a87957696c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576965 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850894.067810:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6e00, rc 0) 00000100:00100000:0.0:1788850894.067895:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+10:6702:x1875746019612544:12345-0@lo:101: Request processed in 229us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850894.067918:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788850894.068042:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019612544:0@lo:101: 00010000:00010000:3.0:1788850894.068066:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3c00/0x7ad3e1a879576965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7ad3e1a87957696c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.068077:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3c00/0x7ad3e1a879576965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7ad3e1a87957696c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850894.068502:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019612672:0@lo:501: 00000100:00100000:3.0:1788850894.068548:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850894.068972:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb240 going to sleep for 11 seconds 00000100:00100000:2.0:1788850894.069042:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612672 00000100:00100000:2.0:1788850894.069052:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612672 00000100:00100000:2.0:1788850894.069092:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788850894.069100:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+10:6702:x1875746019612672:12345-0@lo:501: 00000100:00100000:2.0:1788850894.069557:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+10:6702:x1875746019612672:12345-0@lo:501: Request processed in 456us (1007us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788850894.069577:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788850894.069751:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019612672:0@lo:501: 10000000:01000000:3.0:1788850894.069809:0:6702:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788850894.069848:0:6702:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788850894.069856:0:6702:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3c00/0x7ad3e1a879576965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7ad3e1a87957696c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.069868:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3c00/0x7ad3e1a879576965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7ad3e1a87957696c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.069881:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3c00/0x7ad3e1a879576965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7ad3e1a87957696c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.069914:0:6702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788850894.069943:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a9ba049f800 10000000:01000000:3.0:1788850894.069949:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788850894.069955:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a9b90470000 10000000:01000000:3.0:1788850894.069957:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788850894.069961:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a9b90470000 from 1 10000000:01000000:3.0:1788850894.069964:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788850894.069996:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879576973 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.070004:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879576973 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.070015:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879576973 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850894.070036:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019612800:0@lo:101: 00000100:00100000:3.0:1788850894.070074:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850894.070092:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb600 going to sleep for 11 seconds 00010000:00010000:2.0:1788850894.070162:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788850894.070170:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3c00/0x7ad3e1a879576965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7ad3e1a87957696c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850894.070178:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a3c00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:2.0:1788850894.070182:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3c00/0x7ad3e1a879576965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7ad3e1a87957696c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850894.070191:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3c00/0x7ad3e1a879576965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x7ad3e1a87957696c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788850894.070197:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3c00/0x7ad3e1a879576965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x7ad3e1a87957696c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850894.070203:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788850894.070370:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3c00/0x7ad3e1a879576965 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7ad3e1a87957696c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850894.070376:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788850894.070426:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019612928:0@lo:103: 00000100:00100000:3.0:1788850894.070463:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788850894.070522:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3c00/0x7ad3e1a879576965 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7ad3e1a87957696c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850894.070529:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3c00/0x7ad3e1a879576965 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7ad3e1a87957696c expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850894.070547:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850894.070548:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850894.070550:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850894.070566:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612800 00000100:00100000:2.0:1788850894.070582:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612800 00000100:00100000:2.0:1788850894.070618:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788850894.070638:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+10:6702:x1875746019612800:12345-0@lo:101: 00010000:00010000:2.0:1788850894.070650:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850894.070666:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a3800/0x7ad3e1a87957697a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576973 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850894.070690:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a3800/0x7ad3e1a87957697a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576973 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850894.070703:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a3800/0x7ad3e1a87957697a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576973 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850894.070713:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a3800, rc 0) 00000100:00100000:2.0:1788850894.070752:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+11:6702:x1875746019612800:12345-0@lo:101: Request processed in 115us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850894.070758:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788850894.071177:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019612928 00000100:00100000:3.0:1788850894.071184:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019612928 00000100:00100000:3.0:1788850894.071399:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788850894.071409:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3665c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+11:3311:x1875746019612928:12345-0@lo:103: 00010000:00010000:3.0:1788850894.071430:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788850894.071446:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af6e00/0x7ad3e1a87957696c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ad3e1a879576965 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.071463:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850894.071511:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3665c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+10:3311:x1875746019612928:12345-0@lo:103: Request processed in 105us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850894.071518:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788850894.071582:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019612928:0@lo:103: 00000100:00100000:3.0:1788850894.071926:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019612800:0@lo:101: 00010000:00010000:3.0:1788850894.071948:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879576973 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a87957697a expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.071961:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879576973 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a87957697a expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850894.071981:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788850894.072032:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879576973 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a87957697a expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.072042:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879576973 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a87957697a expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850894.072051:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788850894.072058:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788850894.072065:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788850894.072069:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788850894.072097:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4c00/0x7ad3e1a879576981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.072116:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4c00/0x7ad3e1a879576981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.072126:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4c00/0x7ad3e1a879576981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850894.072145:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613056:0@lo:101: 00000100:00100000:3.0:1788850894.072187:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850894.072374:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613056 00000100:00100000:0.0:1788850894.072382:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613056 00000100:00100000:0.0:1788850894.072427:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788850894.072436:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+10:6702:x1875746019613056:12345-0@lo:101: 00010000:00010000:0.0:1788850894.072448:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850894.072461:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576988 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576981 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850894.072480:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576981 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850894.072490:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576981 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850894.072497:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7400, rc 0) 00000100:00100000:0.0:1788850894.072531:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+11:6702:x1875746019613056:12345-0@lo:101: Request processed in 96us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850894.072537:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788850894.072713:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb600 going to sleep for 11 seconds 00000100:00100000:3.0:1788850894.072729:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613056:0@lo:101: 00010000:00010000:3.0:1788850894.072741:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4c00/0x7ad3e1a879576981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576988 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.072749:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4c00/0x7ad3e1a879576981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576988 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850894.072917:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613184:0@lo:501: 00000100:00100000:3.0:1788850894.072947:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850894.072972:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb600 going to sleep for 11 seconds 00000100:00100000:1.0:1788850894.073050:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613184 00000100:00100000:1.0:1788850894.073055:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613184 00000100:00100000:1.0:1788850894.073086:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788850894.073094:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+11:6702:x1875746019613184:12345-0@lo:501: 00000100:00100000:1.0:1788850894.073568:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+11:6702:x1875746019613184:12345-0@lo:501: Request processed in 473us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850894.073576:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788850894.073716:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613184:0@lo:501: 00000100:00100000:3.0:1788850894.073752:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613312:0@lo:503: 00000100:00100000:3.0:1788850894.073923:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850894.073983:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb600 going to sleep for 11 seconds 00000100:00100000:1.0:1788850894.074205:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613312 00000100:00100000:1.0:1788850894.074213:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613312 00000100:00100000:1.0:1788850894.074417:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788850894.074425:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+11:6702:x1875746019613312:12345-0@lo:503: 00000100:00100000:1.0:1788850894.074734:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+11:6702:x1875746019613312:12345-0@lo:503: Request processed in 310us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850894.074741:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788850894.074939:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613312:0@lo:503: 00000040:00080000:3.0:1788850894.079674:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788850894.079954:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613440:0@lo:502: 00000100:00100000:3.0:1788850894.080069:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850894.080122:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb600 going to sleep for 11 seconds 00000100:00100000:1.0:1788850894.080197:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613440 00000100:00100000:1.0:1788850894.080208:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613440 00000100:00100000:1.0:1788850894.080402:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788850894.080422:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+11:6702:x1875746019613440:12345-0@lo:502: 00000100:00100000:1.0:1788850894.080952:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+11:6702:x1875746019613440:12345-0@lo:502: Request processed in 530us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850894.080961:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788850894.081140:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613440:0@lo:502: 00000040:00080000:3.0:1788850894.081947:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788850894.082207:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788850894.082377:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788850894.082434:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788850894.082470:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788850894.082498:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788850894.082551:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613568:0@lo:502: 00000100:00100000:3.0:1788850894.082702:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850894.082884:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb600 going to sleep for 11 seconds 00000100:00100000:1.0:1788850894.082934:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613568 00000100:00100000:1.0:1788850894.082943:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613568 00000100:00100000:1.0:1788850894.083029:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788850894.083042:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+11:6702:x1875746019613568:12345-0@lo:502: 00000100:00100000:1.0:1788850894.083472:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+11:6702:x1875746019613568:12345-0@lo:502: Request processed in 432us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850894.083492:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788850894.083576:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613568:0@lo:502: 00000040:00080000:0.0:1788850894.083868:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788850894.083886:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788850894.084778:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788850894.087801:0:6723:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788850894.087836:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850894.087840:0:6723:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788850894.087854:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788850894.087879:0:6723:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a9ba0414d40) 00000020:00000080:2.0:1788850894.087914:0:6723:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788850894.087921:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788850894.088024:0:6723:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a9ba049f800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788850894.088034:0:6723:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788850894.088042:0:6723:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7ad3e1a879576996 00010000:00010000:2.0:1788850894.098122:0:6723:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788850894.098548:0:6723:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788850894.108044:0:6723:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788850894.109134:0:6723:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788850894.127544:0:6723:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788850894.129953:0:6723:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788850894.132942:0:6723:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788850894.132960:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850894.132969:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850894.132971:0:6723:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788850894.132974:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788850894.132979:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850894.132987:0:6723:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788850894.132991:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788850894.132993:0:6723:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788850894.133070:0:6723:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850894.133074:0:6723:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850894.133075:0:6723:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788850894.133079:0:6723:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788850894.137041:0:6702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788850894.137106:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788850894.137130:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4c00/0x7ad3e1a879576981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576988 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.137148:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4c00/0x7ad3e1a879576981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576988 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850894.137159:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9ba049f800 from 1 10000000:01000000:3.0:1788850894.137162:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788850894.137235:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a87957699d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.137270:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a87957699d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.137287:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a87957699d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850894.137322:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613696:0@lo:101: 00000100:00100000:3.0:1788850894.137413:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850894.137476:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb540 going to sleep for 11 seconds 00000100:00100000:0.0:1788850894.137826:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613696 00000100:00100000:0.0:1788850894.137838:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613696 00000100:00100000:0.0:1788850894.137895:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788850894.137907:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+11:6702:x1875746019613696:12345-0@lo:101: 00010000:00010000:0.0:1788850894.137923:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850894.137946:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a8795769a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a87957699d expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850894.137978:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a8795769a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a87957699d expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850894.137989:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a8795769a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a87957699d expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850894.137999:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6000, rc 0) 00000100:00100000:0.0:1788850894.138060:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6702:x1875746019613696:12345-0@lo:101: Request processed in 155us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850894.138067:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788850894.138275:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613696:0@lo:101: 00010000:00010000:2.0:1788850894.138312:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a87957699d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795769a4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850894.138328:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a87957699d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a8795769a4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850894.138507:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613824:0@lo:501: 00000100:00100000:2.0:1788850894.138586:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850894.138631:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788850894.139339:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613824 00000100:00100000:0.0:1788850894.139351:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613824 00000100:00100000:0.0:1788850894.139402:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788850894.139412:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6702:x1875746019613824:12345-0@lo:501: 00000100:00100000:0.0:1788850894.139816:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6702:x1875746019613824:12345-0@lo:501: Request processed in 404us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850894.139832:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788850894.139962:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613824:0@lo:501: 00000100:00100000:3.0:1788850894.140018:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613952:0@lo:503: 00000100:00100000:3.0:1788850894.140075:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850894.140117:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788850894.140170:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019613952 00000100:00100000:0.0:1788850894.140176:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019613952 00000100:00100000:0.0:1788850894.140212:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788850894.140229:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6702:x1875746019613952:12345-0@lo:503: 00000100:00100000:0.0:1788850894.140432:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6702:x1875746019613952:12345-0@lo:503: Request processed in 204us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850894.140439:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788850894.140582:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019613952:0@lo:503: 00000040:00080000:3.0:1788850894.141016:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788850894.141093:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019614080:0@lo:502: 00000100:00100000:3.0:1788850894.141139:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850894.141172:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788850894.141317:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614080 00000100:00100000:2.0:1788850894.141323:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614080 00000100:00100000:2.0:1788850894.141366:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788850894.141375:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6702:x1875746019614080:12345-0@lo:502: 00000100:00100000:2.0:1788850894.141549:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6702:x1875746019614080:12345-0@lo:502: Request processed in 174us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850894.141556:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788850894.142388:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019614080:0@lo:502: 00000040:00080000:3.0:1788850894.142712:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788850894.142811:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788850894.142845:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019614208:0@lo:502: 00000100:00100000:3.0:1788850894.142907:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850894.142937:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788850894.143013:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614208 00000100:00100000:2.0:1788850894.143020:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614208 00000100:00100000:2.0:1788850894.143064:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788850894.143074:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6702:x1875746019614208:12345-0@lo:502: 00000100:00100000:2.0:1788850894.144859:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6702:x1875746019614208:12345-0@lo:502: Request processed in 1776us (1940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850894.144875:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788850894.149993:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019614208:0@lo:502: 00000040:00080000:0.0:1788850894.151024:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788850894.151052:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788850894.157424:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850894.157445:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850894.157447:0:6727:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788850894.157463:0:6727:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a9ba049f800 00000020:00000080:2.0:1788850894.157466:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788850894.157492:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850894.157496:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850894.157497:0:6727:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788850894.157507:0:6727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788850894.160375:0:6702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788850894.160429:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788850894.160503:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a87957699d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795769a4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850894.160520:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a87957699d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795769a4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850894.162833:0:6702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788850894.162846:0:6702:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a9ba049f800 10000000:01000000:1.0:1788850894.162851:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a9ba049f800 10000000:01000000:1.0:1788850894.162856:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788850894.162864:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a9ba049f800 from 1 10000000:01000000:1.0:1788850894.162868:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788850894.162925:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a8795769ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850894.162939:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a8795769ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850894.162951:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a8795769ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850894.162982:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019614336:0@lo:101: 00000100:00100000:1.0:1788850894.163073:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850894.163136:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf44c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788850894.163355:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614336 00000100:00100000:3.0:1788850894.163378:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614336 00000100:00100000:3.0:1788850894.163440:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788850894.163451:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6702:x1875746019614336:12345-0@lo:101: 00010000:00010000:3.0:1788850894.163468:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850894.163484:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a4600/0x7ad3e1a8795769b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a8795769ab expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.163513:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a4600/0x7ad3e1a8795769b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a8795769ab expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.163525:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a4600/0x7ad3e1a8795769b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a8795769ab expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.163536:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4600, rc 0) 00000100:00100000:3.0:1788850894.163592:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:6702:x1875746019614336:12345-0@lo:101: Request processed in 144us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850894.163599:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788850894.163716:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019614336:0@lo:101: 00010000:00010000:1.0:1788850894.163733:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a8795769ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795769b2 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850894.163742:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a8795769ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a8795769b2 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850894.164091:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019614464:0@lo:501: 00000100:00100000:1.0:1788850894.164122:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850894.164155:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf44c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788850894.164337:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614464 00000100:00100000:3.0:1788850894.164343:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614464 00000100:00100000:3.0:1788850894.164378:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788850894.164386:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:6702:x1875746019614464:12345-0@lo:501: 00000100:00100000:3.0:1788850894.164682:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:6702:x1875746019614464:12345-0@lo:501: Request processed in 296us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850894.164690:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788850894.165370:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019614464:0@lo:501: 00000100:00100000:1.0:1788850894.165417:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019614592:0@lo:503: 00000100:00100000:1.0:1788850894.165470:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850894.165507:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf44c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788850894.166364:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614592 00000100:00100000:0.0:1788850894.166376:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614592 00000100:00100000:0.0:1788850894.166433:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788850894.166443:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+13:6702:x1875746019614592:12345-0@lo:503: 00000100:00100000:0.0:1788850894.166704:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+13:6702:x1875746019614592:12345-0@lo:503: Request processed in 262us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850894.166712:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788850894.166961:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019614592:0@lo:503: 00000040:00080000:1.0:1788850894.167402:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788850894.167510:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019614720:0@lo:502: 00000100:00100000:1.0:1788850894.167560:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850894.167603:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf44c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788850894.169626:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614720 00000100:00100000:0.0:1788850894.169663:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614720 00000100:00100000:0.0:1788850894.169729:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788850894.169740:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:6702:x1875746019614720:12345-0@lo:502: 00000100:00100000:0.0:1788850894.170118:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:6702:x1875746019614720:12345-0@lo:502: Request processed in 379us (2556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850894.170128:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788850894.170290:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d74380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019614720:0@lo:502: 00000040:00080000:3.0:1788850894.170651:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788850894.170731:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788850894.170819:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788850894.170928:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788850894.170967:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788850894.171016:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788850894.171050:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788850894.171098:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788850894.171145:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788850894.171181:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788850894.171213:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788850894.171260:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788850894.171299:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788850894.171333:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788850894.171378:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788850894.171414:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788850894.171448:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788850894.171493:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788850894.171528:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788850894.171557:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788850894.171615:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788850894.171652:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788850894.171688:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788850894.171753:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788850894.171842:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788850894.171894:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788850894.171951:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788850894.171987:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788850894.172044:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019614848:0@lo:502: 00000100:00100000:3.0:1788850894.172133:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850894.172185:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788850894.172387:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614848 00000100:00100000:0.0:1788850894.172396:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614848 00000100:00100000:0.0:1788850894.172454:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788850894.172463:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:6702:x1875746019614848:12345-0@lo:502: 00000100:00100000:0.0:1788850894.172703:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:6702:x1875746019614848:12345-0@lo:502: Request processed in 240us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850894.172712:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788850894.174075:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019614848:0@lo:502: 00000040:00080000:3.0:1788850894.175445:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788850894.175477:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788850894.179540:0:6728:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788850894.179564:0:6728:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a9bb45ecd40) 00000020:00000080:1.0:1788850894.179593:0:6728:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1788850894.179675:0:6728:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a9ba049f800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788850894.179680:0:6728:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a9ba049f800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788850894.179683:0:6728:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a9ba049f800 3 00010000:00080000:1.0:1788850894.179748:0:6728:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a9baf33b000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.106@tcp at head 00010000:00010000:1.0:1788850894.186638:0:6728:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1788850894.187049:0:6728:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788850894.187095:0:6728:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788850894.187112:0:6728:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7ad3e1a8795769c0 00000100:00080000:1.0:1788850894.187126:0:6728:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788850894.187141:0:6728:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a9baf33b000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1788850894.187190:0:6728:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9bc1d75500 x1875746019614976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788850894.187543:0:6728:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788850894.187647:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875746019614976:0@lo:38: 00000100:00100000:0.0:1788850894.187738:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850894.187856:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019614976 00000100:00100000:0.0:1788850894.187867:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019614976 00000100:00100000:0.0:1788850894.187906:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788850894.187915:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875746019614976:12345-0@lo:38: 00010000:00080000:0.0:1788850894.187946:0:5863:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:0.0:1788850894.187983:0:5863:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7ad3e1a8795769c7 00000004:00100000:0.0:1788850894.188001:0:5863:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788850894.188037:0:5863:0:(import.c:65:import_set_state_nolock()) ffff8a9ba05c5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788850894.188096:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875746019614976:12345-0@lo:38: Request processed in 181us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850894.188104:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788850894.188154:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a9bc1d75500 x1875746019614976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788850904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850894.188177:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788850894.188187:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788850894.188196:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788850894.188201:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788850894.188204:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9baf33b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788850894.188210:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875746019614976:0@lo:38: 00000040:00080000:0.0:1788850894.192276:0:6728:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1788850894.192686:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788850894.192706:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019615104:0@lo:400: 00000100:00100000:2.0:1788850894.192816:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850894.193895:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019615104 00000100:00100000:0.0:1788850894.193909:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019615104 00000100:00100000:0.0:1788850894.194004:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788850894.194015:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019615104:12345-0@lo:400: 00000100:00100000:0.0:1788850894.194106:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019615104:12345-0@lo:400: Request processed in 94us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850894.194114:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788850894.194225:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a9b87d74380 x1875746019615104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850894.194243:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019615104:0@lo:400: 00000020:01000000:3.0:1788850894.199095:0:6702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788850894.199158:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788850894.199189:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a8795769ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795769b2 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.199203:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a8795769ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795769b2 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788850894.199651:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788850894.199654:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788850894.199655:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788850894.199657:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788850894.199658:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788850894.199660:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788850894.199661:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788850894.199663:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788850894.199665:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788850894.199667:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788850894.199669:0:6702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788850894.199674:0:6702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788850894.199677:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788850894.199679:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788850894.199680:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788850894.199681:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788850894.199682:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788850894.199683:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788850894.199684:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788850894.199685:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788850894.199686:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788850894.199687:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788850894.199688:0:6702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788850894.199726:0:6702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788850894.199754:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019615232:0@lo:253: 00000100:00100000:3.0:1788850894.203152:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850894.203686:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf44240 going to sleep for 11 seconds 00000100:00100000:1.0:1788850894.209436:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019615232 00000100:00100000:1.0:1788850894.209478:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019615232 00000100:00100000:1.0:1788850894.209565:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788850894.209578:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:6702:x1875746019615232:12345-0@lo:253: 20000000:01000000:1.0:1788850894.209619:0:5855:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788850894.209637:0:5855:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788850894.246752:0:5855:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788850894.246887:0:5855:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788850894.246994:0:5877:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788850894.246999:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788850894.247032:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a8795769ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850894.247054:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a2c00/0x7ad3e1a87957692d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576926 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850894.247065:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a8795769ce lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850894.247114:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a2c00/0x7ad3e1a87957692d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576926 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850894.247130:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a2c00/0x7ad3e1a87957692d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576926 expref: 13 pid: 5853 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850894.247146:0:5877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1875746019615360:0@lo:104: 00000100:00100000:2.0:1788850894.250543:0:5877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850894.250724:0:5877:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788850894.252293:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019615360 00000100:00100000:1.0:1788850894.252309:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019615360 00000100:00100000:1.0:1788850894.252394:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788850894.252407:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+3:5877:x1875746019615360:12345-0@lo:104: 00010000:00010000:1.0:1788850894.252433:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a87957692d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850894.252691:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788850894.252699:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+3:5877:x1875746019615360:12345-0@lo:104: Request processed in 295us (2166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850894.252707:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788850894.252918:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788850894.252943:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a87957692d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.252953:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6200 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:3.0:1788850894.252958:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576926 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a87957692d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.252968:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a87957692d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788850894.252976:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a87957692d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850894.252982:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788850894.253024:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a87957692d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.253030:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788850894.253052:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576926 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a87957692d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.253060:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576926 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a87957692d expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.253081:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850894.253083:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850894.253085:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850894.253158:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788850894.253178:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019615488:0@lo:103: 00000100:00100000:1.0:1788850894.253246:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850894.253343:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019615488 00000100:00100000:3.0:1788850894.253349:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019615488 00010000:00010000:3.0:1788850894.253373:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a2c00/0x7ad3e1a87957692d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576926 expref: 14 pid: 5853 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850894.253417:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788850894.253424:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86787450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+14:3308:x1875746019615488:12345-0@lo:103: 00010000:00010000:3.0:1788850894.253439:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788850894.253445:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a2c00/0x7ad3e1a87957692d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576926 expref: 14 pid: 5853 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.253456:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a2c00/0x7ad3e1a87957692d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576926 expref: 14 pid: 5853 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.253477:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a8795769ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.253487:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a8795769ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788850894.253508:0:5848:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006508595s 00010000:00010000:3.0:1788850894.253513:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a8795769ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.253520:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a8795769ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.253526:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a8795769ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.253532:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a8795769ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.253536:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a3c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788850894.253541:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a8795769ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.253565:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a8795769ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.253575:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a8795769ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.253585:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850894.253620:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86787450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+14:3308:x1875746019615488:12345-0@lo:103: Request processed in 197us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850894.253627:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788850894.254003:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019615488:0@lo:103: 00010000:00010000:2.0:1788850894.259580:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a2c00/0x7ad3e1a87957692d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576926 expref: 13 pid: 5853 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850894.259608:0:5877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1875746019615360:0@lo:104: 00010000:00010000:2.0:1788850894.259639:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a8795769ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.259730:0:5877:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a8795769ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.259738:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a8795769ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850894.259744:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a3c00/0x7ad3e1a8795769ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850894.264344:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+12:6702:x1875746019615232:12345-0@lo:253: Request processed in 54756us (61192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850894.264363:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788850894.264468:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:6702:1875746019615232:0@lo:253: 10000000:01000000:3.0:1788850894.264488:0:6702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788850894.264492:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788850894.264494:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788850894.264496:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788850894.264497:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788850894.264499:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788850894.264500:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788850894.264502:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788850894.264503:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788850894.264505:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788850894.264507:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788850894.264523:0:6702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788850894.264545:0:6702:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788850894.271197:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788850894.271421:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788850894.271633:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788850894.271888:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788850894.272089:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788850894.272362:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788850894.274628:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788850894.582481:0:6702:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788850894.582489:0:6702:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788850894.582526:0:6702:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788850894.582593:0:6702:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.106@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788850894.582612:0:6702:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788850894.582645:0:6702:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788850894.610661:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850895.637666:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850896.663725:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850897.682097:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850898.706044:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850899.474380:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019615616:0@lo:400: 00000100:00100000:2.0:1788850899.474458:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850899.474504:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788850899.474509:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019615744:0@lo:400: 00000100:00100000:2.0:1788850899.474534:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850899.474561:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019615872:0@lo:400: 00000100:00100000:2.0:1788850899.474585:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850899.474613:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019615616 00000100:00100000:2.0:1788850899.474619:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019615616 00000100:00100000:2.0:1788850899.474670:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788850899.474678:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:3310:x1875746019615616:12345-0@lo:400: 00000100:00100000:2.0:1788850899.474722:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:3310:x1875746019615616:12345-0@lo:400: Request processed in 45us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850899.474729:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788850899.474764:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019615744 00000100:00100000:2.0:1788850899.474777:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019615744 00000100:00100000:2.0:1788850899.474820:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019615872 00000100:00100000:2.0:1788850899.474824:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019615872 00000100:00100000:2.0:1788850899.474847:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788850899.474853:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019615744:12345-0@lo:400: 00000100:00100000:2.0:1788850899.474883:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019615744:12345-0@lo:400: Request processed in 31us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850899.474889:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788850899.474901:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788850899.474907:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019615872:12345-0@lo:400: 00000100:00100000:2.0:1788850899.474937:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019615872:12345-0@lo:400: Request processed in 30us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850899.474943:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788850899.475291:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9b87d76680 x1875746019615872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850899.475305:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019615872:0@lo:400: 00010000:00080000:2.0:1788850899.475334:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9b87d74700 x1875746019615744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850915 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850899.475343:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019615744:0@lo:400: 00000100:00100000:2.0:1788850899.475351:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019615616:0@lo:400: 00000100:00080000:1.0:1788850899.482172:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788850899.734492:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788850900.726605:0:7071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788850900.754717:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850901.778752:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788850902.035069:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788850902.035075:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a9ba0462000 from 21 10000000:01000000:2.0:1788850902.035079:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788850902.035124:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3400/0x7ad3e1a8795769d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850902.035150:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3400/0x7ad3e1a8795769d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850902.035161:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3400/0x7ad3e1a8795769d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850902.035197:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019616000:0@lo:101: 00000100:00100000:2.0:1788850902.035266:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850902.035318:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98d7af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788850902.035504:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019616000 00000100:00100000:1.0:1788850902.035512:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019616000 00000100:00100000:1.0:1788850902.035573:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788850902.035583:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5858:x1875746019616000:12345-0@lo:101: 00010000:00010000:1.0:1788850902.035597:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850902.035620:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b8168ea00/0x7ad3e1a8795769dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a8795769d5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850902.035643:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b8168ea00/0x7ad3e1a8795769dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a8795769d5 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850902.035654:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b8168ea00/0x7ad3e1a8795769dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a8795769d5 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850902.035663:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168ea00, rc 0) 00000100:00100000:1.0:1788850902.035709:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:5858:x1875746019616000:12345-0@lo:101: Request processed in 128us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850902.035716:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788850902.035823:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019616000:0@lo:101: 00010000:00010000:2.0:1788850902.035838:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3400/0x7ad3e1a8795769d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795769dc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850902.035848:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3400/0x7ad3e1a8795769d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a8795769dc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850902.035905:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019616128:0@lo:501: 00000100:00100000:2.0:1788850902.035930:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850902.035960:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98d7af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788850902.036015:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019616128 00000100:00100000:1.0:1788850902.036020:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019616128 00000100:00100000:1.0:1788850902.036052:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788850902.036068:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+13:5858:x1875746019616128:12345-0@lo:501: 00000100:00100000:1.0:1788850902.036419:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+13:5858:x1875746019616128:12345-0@lo:501: Request processed in 360us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850902.036427:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788850902.036626:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019616128:0@lo:501: 00000100:00100000:2.0:1788850902.036656:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019616256:0@lo:503: 00000100:00100000:2.0:1788850902.036694:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850902.036718:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98d7af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788850902.036774:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019616256 00000100:00100000:1.0:1788850902.036778:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019616256 00000100:00100000:1.0:1788850902.036835:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788850902.036842:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:5858:x1875746019616256:12345-0@lo:503: 00000100:00100000:1.0:1788850902.037254:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:5858:x1875746019616256:12345-0@lo:503: Request processed in 410us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850902.037269:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788850902.037382:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019616256:0@lo:503: 00000100:00100000:2.0:1788850902.038513:0:7144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:7144:1875746019616384:0@lo:502: 00000100:00100000:2.0:1788850902.038584:0:7144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850902.038680:0:7144:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98d7a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788850902.038726:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019616384 00000100:00100000:1.0:1788850902.038733:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019616384 00000100:00100000:1.0:1788850902.038849:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788850902.038859:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7144:x1875746019616384:12345-0@lo:502: 00000100:00100000:1.0:1788850902.039154:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7144:x1875746019616384:12345-0@lo:502: Request processed in 296us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850902.039161:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788850902.039411:0:7144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:7144:1875746019616384:0@lo:502: 00000100:00100000:3.0:1788850902.039461:0:7144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:7144:1875746019616512:0@lo:502: 00000100:00100000:3.0:1788850902.039495:0:7144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850902.039621:0:7144:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb62eb240 going to sleep for 11 seconds 00000100:00100000:1.0:1788850902.039698:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019616512 00000100:00100000:1.0:1788850902.039703:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019616512 00000100:00100000:1.0:1788850902.039722:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788850902.039728:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7144:x1875746019616512:12345-0@lo:502: 00000100:00100000:1.0:1788850902.039890:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7144:x1875746019616512:12345-0@lo:502: Request processed in 162us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850902.039896:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788850902.039976:0:7144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:7144:1875746019616512:0@lo:502: 00000040:00080000:3.0:1788850902.039996:0:7144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788850902.040275:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788850902.040297:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788850902.040308:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3400/0x7ad3e1a8795769d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795769dc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850902.040320:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3400/0x7ad3e1a8795769d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795769dc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850902.040330:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788850902.040333:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a9ba0462000 from 4 10000000:01000000:1.0:1788850902.040336:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788850902.040366:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a8795769e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850902.040387:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a8795769e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850902.040398:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a8795769e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850902.040413:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019616640:0@lo:101: 00000100:00100000:1.0:1788850902.040445:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850902.040478:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf443c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850902.040599:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019616640 00000100:00100000:3.0:1788850902.040604:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019616640 00000100:00100000:3.0:1788850902.040638:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788850902.040645:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:5858:x1875746019616640:12345-0@lo:101: 00010000:00010000:3.0:1788850902.040654:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850902.040667:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a8795769ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a8795769e3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850902.040702:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a8795769ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a8795769e3 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850902.040713:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a8795769ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a8795769e3 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850902.040722:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a5400, rc 0) 00000100:00100000:3.0:1788850902.040762:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019616640:12345-0@lo:101: Request processed in 117us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850902.040767:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788850902.040867:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019616640:0@lo:101: 00010000:00010000:1.0:1788850902.040881:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a8795769e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795769ea expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850902.040889:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a8795769e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a8795769ea expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850902.040932:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019616768:0@lo:256: 00000100:00100000:1.0:1788850902.040962:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850902.040985:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf443c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850902.041031:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019616768 00000100:00100000:3.0:1788850902.041036:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019616768 00000100:00100000:3.0:1788850902.041052:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788850902.041058:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019616768:12345-0@lo:256: 20000000:01000000:3.0:1788850902.041081:0:5855:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788850902.041099:0:5855:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788850902.041102:0:5855:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788850902.041335:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019616768:0@lo:256: 10000000:01000000:1.0:1788850902.041375:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788850902.041381:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a8795769e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795769ea expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850902.041389:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a8795769e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795769ea expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850902.041404:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788850902.041406:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788850902.041408:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788850902.041422:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168fa00/0x7ad3e1a8795769f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850902.041429:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b8168fa00/0x7ad3e1a8795769f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850902.041437:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b8168fa00/0x7ad3e1a8795769f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850902.041448:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019616896:0@lo:101: 00000100:00100000:1.0:1788850902.041472:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850902.041480:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf443c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850902.041519:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019616768:12345-0@lo:256: Request processed in 459us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850902.041526:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788850902.041544:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019616896 00000100:00100000:3.0:1788850902.041547:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019616896 00000100:00100000:3.0:1788850902.041561:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788850902.041566:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019616896:12345-0@lo:101: 00010000:00010000:3.0:1788850902.041574:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850902.041582:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a5a00/0x7ad3e1a8795769f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a8795769f1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850902.041606:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a5a00/0x7ad3e1a8795769f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a8795769f1 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850902.041627:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a5a00/0x7ad3e1a8795769f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a8795769f1 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850902.041634:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a5a00, rc 0) 00000100:00100000:3.0:1788850902.041671:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019616896:12345-0@lo:101: Request processed in 104us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850902.041677:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788850902.041739:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019616896:0@lo:101: 00010000:00010000:1.0:1788850902.041749:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b8168fa00/0x7ad3e1a8795769f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795769f8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850902.041757:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168fa00/0x7ad3e1a8795769f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a8795769f8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850902.041827:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019617024:0@lo:501: 00000100:00100000:1.0:1788850902.041851:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850902.041865:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf443c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850902.041919:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617024 00000100:00100000:3.0:1788850902.041923:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617024 00000100:00100000:3.0:1788850902.041940:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788850902.041946:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019617024:12345-0@lo:501: 00000100:00100000:3.0:1788850902.042518:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019617024:12345-0@lo:501: Request processed in 569us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850902.042526:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788850902.042640:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019617024:0@lo:501: 00000100:00100000:1.0:1788850902.042670:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019617152:0@lo:503: 00000100:00100000:1.0:1788850902.042713:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850902.042810:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf443c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788850902.042822:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617152 00000100:00100000:1.0:1788850902.042826:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617152 00000100:00100000:2.0:1788850902.042994:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788850902.043004:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019617152:12345-0@lo:503: 00000100:00100000:2.0:1788850902.043650:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019617152:12345-0@lo:503: Request processed in 647us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850902.043657:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788850902.044055:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019617152:0@lo:503: 00000100:00100000:1.0:1788850902.044630:0:7145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:7145:1875746019617280:0@lo:502: 00000100:00100000:1.0:1788850902.044687:0:7145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850902.044760:0:7145:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf44600 going to sleep for 11 seconds 00000100:00100000:2.0:1788850902.044926:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617280 00000100:00100000:2.0:1788850902.044933:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617280 00000100:00100000:2.0:1788850902.045009:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788850902.045019:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+15:7145:x1875746019617280:12345-0@lo:502: 00000100:00100000:2.0:1788850902.045321:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+15:7145:x1875746019617280:12345-0@lo:502: Request processed in 303us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850902.045329:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788850902.045410:0:7145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:7145:1875746019617280:0@lo:502: 00000020:01000000:1.0:1788850902.045439:0:7145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788850902.045447:0:7145:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788850902.045454:0:7145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850902.045457:0:7145:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788850902.045462:0:7145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788850902.045466:0:7145:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:01000000:1.0:1788850902.045489:0:7145:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788850902.045492:0:7145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788850902.045518:0:7145:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a9b98d14d40) 00000020:00000080:1.0:1788850902.045540:0:7145:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788850902.045548:0:7145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788850902.045654:0:7145:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788850902.045660:0:7145:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788850902.045668:0:7145:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ad3e1a879576a06 00010000:00080000:1.0:1788850902.045699:0:7145:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a9b8675a000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.106@tcp at head 00010000:00010000:1.0:1788850902.045960:0:7145:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788850902.100477:0:7145:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788850902.100501:0:7145:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788850902.101350:0:7145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788850902.101544:0:7145:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788850902.101590:0:7145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788850902.101666:0:7145:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788850902.102326:0:7148:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788850902.102331:0:7148:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788850902.102917:0:7145:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788850902.102930:0:7145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788850902.102961:0:7145:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788850902.102981:0:7145:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ad3e1a879576a0d 00000100:00080000:0.0:1788850902.102991:0:7145:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788850902.103003:0:7145:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a9b8675a000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1788850902.103057:0:7145:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9b99172680 x1875746019617408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788850902.103645:0:7145:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788850902.103749:0:7145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850902.103754:0:7145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850902.103756:0:7145:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788850902.103760:0:7145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788850902.103764:0:7145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850902.103765:0:7145:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788850902.103769:0:7145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788850902.103771:0:7145:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788850902.103822:0:7145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:7145:1875746019617536:0@lo:502: 00000100:00100000:0.0:1788850902.103891:0:7145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850902.103930:0:7145:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9a8251f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788850902.103951:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617536 00000100:00100000:0.0:1788850902.103957:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617536 00000100:00100000:0.0:1788850902.103990:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788850902.103997:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+15:7145:x1875746019617536:12345-0@lo:502: 00000100:00100000:0.0:1788850902.104218:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+15:7145:x1875746019617536:12345-0@lo:502: Request processed in 220us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850902.104225:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788850902.104270:0:7145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:7145:1875746019617536:0@lo:502: 00000020:01000000:0.0:1788850902.104292:0:7145:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850902.104295:0:7145:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850902.104296:0:7145:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788850902.104300:0:7145:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788850902.104400:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788850902.104415:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788850902.104424:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168fa00/0x7ad3e1a8795769f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795769f8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850902.104440:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b8168fa00/0x7ad3e1a8795769f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a8795769f8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850902.104450:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788850902.104453:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a9b90470000 from 1 10000000:01000000:0.0:1788850902.104455:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788850902.104477:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879576a14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850902.104485:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879576a14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850902.104494:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879576a14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850902.104504:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019617664:0@lo:101: 00000100:00100000:0.0:1788850902.104529:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850902.104543:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9a8251f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788850902.104555:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617664 00000100:00100000:0.0:1788850902.104558:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617664 00000100:00100000:0.0:1788850902.104577:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788850902.104583:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019617664:12345-0@lo:101: 00010000:00010000:0.0:1788850902.104591:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850902.104604:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af7800/0x7ad3e1a879576a1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576a14 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850902.104636:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af7800/0x7ad3e1a879576a1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576a14 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850902.104656:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af7800/0x7ad3e1a879576a1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576a14 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850902.104665:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7800, rc 0) 00000100:00100000:0.0:1788850902.104692:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019617664:12345-0@lo:101: Request processed in 109us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850902.104697:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788850902.104721:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019617664:0@lo:101: 00010000:00010000:0.0:1788850902.104731:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879576a14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576a1b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850902.104739:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879576a14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576a1b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850902.104778:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019617792:0@lo:501: 00000100:00100000:0.0:1788850902.104824:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850902.104836:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9a8251f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788850902.104846:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617792 00000100:00100000:0.0:1788850902.104849:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617792 00000100:00100000:0.0:1788850902.104864:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788850902.104871:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019617792:12345-0@lo:501: 00000100:00100000:0.0:1788850902.105082:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019617792:12345-0@lo:501: Request processed in 212us (257us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788850902.105089:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788850902.105117:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019617792:0@lo:501: 10000000:01000000:0.0:1788850902.105134:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788850902.105144:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879576a14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576a1b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850902.105151:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879576a14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576a1b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850902.105550:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019617408:0@lo:8: 00000100:00100000:1.0:1788850902.105588:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850902.105981:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617408 00000100:00100000:0.0:1788850902.105988:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617408 00000100:00100000:0.0:1788850902.106055:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788850902.106071:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875746019617408:12345-0@lo:8: 00010000:00080000:0.0:1788850902.106098:0:6704:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000020:00000080:0.0:1788850902.106125:0:6704:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ad3e1a879576a22 00002000:00100000:0.0:1788850902.106168:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a9baf338800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788850902.106174:0:6704:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788850902.106189:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788850902.106315:0:6704:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788850902.106459:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788850902.106485:0:6704:0:(import.c:65:import_set_state_nolock()) ffff8a9baf33d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788850902.106539:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875746019617408:12345-0@lo:8: Request processed in 466us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850902.106546:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788850902.107035:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019617920:0@lo:400: 00000100:00100000:3.0:1788850902.107089:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850902.107138:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788850902.107146:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019618048:0@lo:400: 00000100:00100000:3.0:1788850902.107173:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850902.107221:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019617920 00000100:00100000:3.0:1788850902.107227:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019617920 00000100:00100000:3.0:1788850902.107258:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618048 00000100:00100000:3.0:1788850902.107261:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618048 00000100:00100000:3.0:1788850902.107280:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788850902.107302:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019617920:12345-0@lo:400: 00000100:00100000:3.0:1788850902.107340:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019617920:12345-0@lo:400: Request processed in 39us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850902.107347:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788850902.107361:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788850902.107367:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019618048:12345-0@lo:400: 00000100:00100000:3.0:1788850902.107396:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019618048:12345-0@lo:400: Request processed in 30us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850902.107402:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788850902.107423:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788850902.107447:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb3664e00 x1875746019617920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850902.107461:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019617920:0@lo:400: 00010000:00080000:3.0:1788850902.107486:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb3665c00 x1875746019618048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850918 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850902.107495:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019618048:0@lo:400: 00010000:00080000:1.0:1788850902.108365:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9b99172680 x1875746019617408/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788850912 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850902.108377:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788850902.108387:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788850902.108398:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788850902.108404:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788850902.108407:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b8675a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788850902.108434:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788850902.108441:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019617408:0@lo:8: 00000004:00080000:2.0:1788850902.111215:0:7148:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788850902.111398:0:7148:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 235052615911ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788850902.168618:0:7149:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788850902.168658:0:7149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7149:1875746019618304:0@lo:7: 00000100:00100000:3.0:1788850902.168736:0:7149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850902.168817:0:7149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb62eb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788850902.168993:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019618176:0@lo:13: 00000100:00100000:0.0:1788850902.169034:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850902.170767:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618176 00000100:00100000:3.0:1788850902.170797:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618176 00000100:00100000:3.0:1788850902.170864:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788850902.170875:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875746019618176:12345-0@lo:13: 00002000:00000024:3.0:1788850902.170913:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788850902.170995:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99171880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875746019618176:12345-0@lo:13: Request processed in 121us (1959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850902.171002:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788850902.171024:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788850902.171071:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb3665c00 x1875746019618176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850918 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850902.171094:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019618176:0@lo:13: 00000100:00100000:1.0:1788850902.173311:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618304 00000100:00100000:1.0:1788850902.173323:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618304 00000100:00100000:1.0:1788850902.173376:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788850902.173385:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7149:x1875746019618304:12345-0@lo:7: 00002000:00080000:1.0:1788850902.183772:0:6707:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788850902.183810:0:6707:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788850902.183922:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7149:x1875746019618304:12345-0@lo:7: Request processed in 10534us (15182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850902.183932:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788850902.184082:0:7149:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb3664e00 x1875746019618304/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788850918 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850902.184099:0:7149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7149:1875746019618304:0@lo:7: 00000004:00080000:2.0:1788850902.184115:0:7149:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788850902.184160:0:7149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7149:1875746019618432:0@lo:5: 00000100:00100000:2.0:1788850902.184199:0:7149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850902.184237:0:7149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf42480 going to sleep for 11 seconds 00000100:00100000:0.0:1788850902.184813:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618432 00000100:00100000:0.0:1788850902.184822:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618432 00000100:00100000:0.0:1788850902.184878:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788850902.184889:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7149:x1875746019618432:12345-0@lo:5: 00002000:00080000:0.0:1788850902.184927:0:6704:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788850902.184932:0:6704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788850902.187448:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7149:x1875746019618432:12345-0@lo:5: Request processed in 2554us (3243us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788850902.187462:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788850902.189576:0:7149:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9b87d74700 x1875746019618432/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788850918 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850902.189603:0:7149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7149:1875746019618432:0@lo:5: 00000004:00080000:3.0:1788850902.189635:0:7149:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788850902.189677:0:7149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7149:1875746019618560:0@lo:700: 00000100:00100000:3.0:1788850902.189734:0:7149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850902.189776:0:7149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb62ebb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788850902.190156:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618560 00000100:00100000:1.0:1788850902.190164:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618560 00000100:00100000:1.0:1788850902.190217:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788850902.190227:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7149:x1875746019618560:12345-0@lo:700: 00000100:00100000:1.0:1788850902.190265:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d74700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6714:1875746019618688:0@lo:700: 00000100:00100000:1.0:1788850902.190310:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850902.190330:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf44300 going to sleep for 11 seconds 00000100:00100000:1.0:1788850902.190355:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618688 00000100:00100000:1.0:1788850902.190359:0:5868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618688 00000100:00100000:1.0:1788850902.190388:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788850902.190395:0:5868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6714:x1875746019618688:12345-0@lo:700: 00000004:00080000:3.0:1788850902.204330:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:2.0:1788850902.296904:0:5868:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788850902.307496:0:5868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6714:x1875746019618688:12345-0@lo:700: Request processed in 117092us (117176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850902.307529:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788850902.309933:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bc1d74700 x1875746019618688/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788850918 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850902.309952:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d74700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6714:1875746019618688:0@lo:700: 40000000:02000000:3.0:1788850902.309965:0:6714:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1788850902.376774:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788850902.376815:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788850902.376985:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7149:x1875746019618560:12345-0@lo:700: Request processed in 186755us (187244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850902.377006:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788850902.377108:0:7149:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb3665c00 x1875746019618560/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788850918 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850902.377120:0:7149:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788850902.377137:0:7149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7149:1875746019618560:0@lo:700: 00000004:02000040:3.0:1788850902.398314:0:7149:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788850902.403957:0:7149:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3666a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7149:1875746019618816:0@lo:5: 00000100:00100000:3.0:1788850902.404073:0:7149:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850902.404144:0:7149:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb62eb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788850902.405744:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618816 00000100:00100000:1.0:1788850902.405755:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618816 00000100:00100000:1.0:1788850902.405833:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788850902.405844:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7149:x1875746019618816:12345-0@lo:5: 00002000:00080000:1.0:1788850902.413505:0:6707:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788850902.413528:0:6707:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788850902.425111:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7149:x1875746019618816:12345-0@lo:5: Request processed in 19258us (21027us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788850902.425146:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788850902.429760:0:7149:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb3666a00 x1875746019618816/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788850918 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850902.429805:0:7149:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3666a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7149:1875746019618816:0@lo:5: 00000004:00080000:0.0:1788850902.429823:0:7149:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788850902.802199:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850903.826288:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850904.851341:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788850905.745710:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788850905.874056:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850906.900459:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788850907.154980:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019619200:0@lo:400: 00000100:00100000:3.0:1788850907.155059:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850907.155115:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788850907.155123:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019619328:0@lo:400: 00000100:00100000:3.0:1788850907.155154:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850907.155196:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619200 00000100:00100000:3.0:1788850907.155205:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619200 00000100:00100000:3.0:1788850907.155263:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788850907.155271:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019619200:12345-0@lo:400: 00000100:00100000:3.0:1788850907.155334:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019619200:12345-0@lo:400: Request processed in 64us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850907.155342:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788850907.155364:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788850907.155391:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb3665c00 x1875746019619200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850907.155405:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019619200:0@lo:400: 00000100:00100000:2.0:1788850907.155620:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019618944:0@lo:400: 00000100:00100000:2.0:1788850907.155664:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850907.155688:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788850907.155694:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019619072:0@lo:400: 00000100:00100000:2.0:1788850907.155718:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850907.155746:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619072 00000100:00100000:2.0:1788850907.155750:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619072 00000100:00100000:2.0:1788850907.155776:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788850907.155802:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019619072:12345-0@lo:400: 00000100:00100000:2.0:1788850907.155838:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019619072:12345-0@lo:400: Request processed in 37us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850907.155844:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788850907.155869:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb3665180 x1875746019619072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850907.155879:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019619072:0@lo:400: 00000100:00100000:0.0:1788850907.156224:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619328 00000100:00100000:0.0:1788850907.156229:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619328 00000100:00100000:0.0:1788850907.156363:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788850907.156372:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019619328:12345-0@lo:400: 00000100:00100000:0.0:1788850907.156416:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019619328:12345-0@lo:400: Request processed in 47us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850907.156422:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788850907.158740:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788850907.159383:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019618944 00000100:00100000:0.0:1788850907.159394:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019618944 00000100:00100000:0.0:1788850907.159450:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788850907.159461:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+16:3308:x1875746019618944:12345-0@lo:400: 00000100:00100000:0.0:1788850907.159567:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+16:3308:x1875746019618944:12345-0@lo:400: Request processed in 108us (3903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850907.159575:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1788850907.159656:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb3664e00 x1875746019619328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850907.159685:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788850907.159702:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019619328:0@lo:400: 00000100:00100000:2.0:1788850907.159876:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019618944:0@lo:400: 00000100:00100000:1.0:1788850907.672098:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019619456:0@lo:13: 00000100:00100000:1.0:1788850907.672187:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850907.672278:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619456 00000100:00100000:1.0:1788850907.672288:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619456 00000100:00100000:1.0:1788850907.672337:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788850907.672346:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019619456:12345-0@lo:13: 00002000:00000024:1.0:1788850907.672381:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850907.672428:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019619456:12345-0@lo:13: Request processed in 84us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850907.672434:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788850907.672473:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9b99170a80 x1875746019619456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850923 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850907.672491:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019619456:0@lo:13: 00010000:00010000:2.0:1788850907.922320:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850908.952316:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850909.971212:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850911.000343:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850912.018427:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850912.277744:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019619712:0@lo:400: 00000100:00100000:2.0:1788850912.277868:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850912.277958:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788850912.277966:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019619840:0@lo:400: 00000100:00100000:2.0:1788850912.278008:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850912.278058:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019619968:0@lo:400: 00000100:00100000:3.0:1788850912.278096:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850912.278154:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788850912.278155:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619712 00000100:00100000:3.0:1788850912.278162:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019619584:0@lo:400: 00000100:00100000:2.0:1788850912.278166:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619712 00000100:00100000:3.0:1788850912.278189:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850912.278234:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619840 00000100:00100000:3.0:1788850912.278240:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619840 00000100:00100000:3.0:1788850912.278288:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788850912.278296:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019619840:12345-0@lo:400: 00000100:00100000:3.0:1788850912.278348:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019619840:12345-0@lo:400: Request processed in 52us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850912.279473:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619584 00000100:00100000:0.0:1788850912.279489:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619584 00000100:00100000:2.0:1788850912.279493:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788850912.279510:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019619712:12345-0@lo:400: 00000100:00100000:0.0:1788850912.279538:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788850912.279547:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+16:3308:x1875746019619584:12345-0@lo:400: 00000100:00100000:2.0:1788850912.279586:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019619712:12345-0@lo:400: Request processed in 81us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850912.279594:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788850912.279603:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+16:3308:x1875746019619584:12345-0@lo:400: Request processed in 57us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850912.279610:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788850912.279634:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019619968 00000100:00100000:2.0:1788850912.279640:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019619968 00000100:00100000:2.0:1788850912.279681:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788850912.279689:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019619968:12345-0@lo:400: 00000100:00100000:2.0:1788850912.279724:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019619968:12345-0@lo:400: Request processed in 37us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850912.279730:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788850912.279822:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9b87d74380 x1875746019619840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850912.279838:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019619840:0@lo:400: 00010000:00080000:2.0:1788850912.279874:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9b87d74e00 x1875746019619712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850912.279883:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019619712:0@lo:400: 00000100:00080000:2.0:1788850912.279942:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788850912.279948:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788850912.279977:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019619584:0@lo:400: 00010000:00080000:2.0:1788850912.280000:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9b87d77480 x1875746019619968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850912.280011:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019619968:0@lo:400: 00000100:00100000:3.0:1788850912.283446:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000004:1.0:1788850912.717747:0:7638:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788850912.717756:0:7638:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788850912.718231:0:7638:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a9b866a7000 00000020:01000004:1.0:1788850912.718250:0:7638:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788850912.718265:0:7638:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788850912.718281:0:7638:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a9b98d119c0) 00000020:00000080:1.0:1788850912.718298:0:7638:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788850912.736679:0:7638:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788850912.737323:0:7638:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788850912.780765:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00000100:00100000:1.0:1788850912.786205:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788850912.786228:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019620096:0@lo:13: 00000100:00100000:1.0:1788850912.786295:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850912.786360:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019620096 00000100:00100000:1.0:1788850912.786368:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019620096 00000100:00100000:1.0:1788850912.786422:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788850912.786431:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019620096:12345-0@lo:13: 00002000:00000024:1.0:1788850912.786465:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850912.786585:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019620096:12345-0@lo:13: Request processed in 82us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850912.786594:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788850912.786637:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bc1d77800 x1875746019620096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850928 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850912.786655:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019620096:0@lo:13: 00100000:10000000:2.0:1788850912.794930:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788850912.794967:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788850912.795026:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788850912.795052:0:7638:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788850912.795422:0:7638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788850912.795434:0:7638:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788850912.795445:0:7638:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7ad3e1a879576a30 00000020:01000004:2.0:1788850912.795453:0:7638:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788850912.795476:0:7638:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.106@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788850912.795480:0:7638:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788850912.795487:0:7638:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788850912.795512:0:7638:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788850912.795517:0:7638:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788850912.842344:0:7638:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788850912.842383:0:7638:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.106@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788850912.842387:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788850912.842388:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788850912.842390:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788850912.842391:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788850912.842392:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788850912.842394:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788850912.842395:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788850912.842396:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788850912.842398:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788850912.842414:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788850912.842415:0:7638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788850912.842419:0:7638:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788850912.842421:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788850912.842422:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788850912.842423:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788850912.842424:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788850912.842424:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788850912.842425:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788850912.842426:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788850912.842427:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788850912.842428:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788850912.842429:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788850912.842429:0:7638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788850912.842454:0:7638:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788850912.842472:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019620224:0@lo:253: 00000100:00100000:1.0:1788850912.842614:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850912.842733:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98a21d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788850912.845214:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019620224 00000100:00100000:0.0:1788850912.845235:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019620224 00000100:00100000:3.0:1788850912.845565:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788850912.845576:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+16:7638:x1875746019620224:12345-0@lo:253: 20000000:01000000:3.0:1788850912.845613:0:5853:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788850912.845617:0:5853:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788850912.845622:0:5853:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788850912.845626:0:5853:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788850912.851481:0:5853:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788850912.851732:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788850912.851748:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788850912.853117:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788850912.853144:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788850912.853233:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788850912.853320:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788850912.853695:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788850912.853717:0:5853:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.106@tcp 20000000:01000000:3.0:1788850912.853720:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.106@tcp (null) (null) (null) 00000040:00080000:3.0:1788850912.853756:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788850912.853765:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788850912.855388:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788850912.855433:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.106@tcp (null) (null) 00000040:00080000:3.0:1788850912.855485:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788850912.855496:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788850912.855528:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788850912.855583:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788850912.862913:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788850912.863740:0:5853:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.106@tcp 20000000:01000000:3.0:1788850912.863743:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.106@tcp (null) (null) (null) 00000040:00080000:3.0:1788850912.864733:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788850912.864752:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788850912.864822:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788850912.864831:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.106@tcp (null) (null) 00000040:00080000:3.0:1788850912.865205:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788850912.865218:0:5853:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788850912.865300:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788850912.865337:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788850912.865360:0:5853:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1788850912.865363:0:5853:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1788850912.865369:0:5853:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788850912.865370:0:5853:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788850912.865373:0:5853:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788850912.865387:0:5853:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788850912.865390:0:5853:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788850912.865447:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788850912.865450:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788850912.869344:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788850912.869468:0:7640:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788850912.869671:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788850912.870523:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788850912.870575:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788850912.870658:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1788850912.870673:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788850912.870676:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788850912.871552:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788850912.871607:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788850912.871658:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788850912.872223:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788850912.872269:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788850912.872324:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788850912.872337:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788850912.872339:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788850912.873147:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788850912.873380:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788850912.873431:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788850912.873574:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788850912.873588:0:5853:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788850912.873590:0:5853:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788850912.874595:0:7643:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788850912.874654:0:7643:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788850912.874707:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788850912.875545:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788850912.875593:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788850912.875656:0:5853:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1788850912.875674:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788850912.875693:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576a37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.875711:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576981 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.875719:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a4600/0x7ad3e1a8795769b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a8795769ab expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.875725:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b8168ea00/0x7ad3e1a8795769dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a8795769d5 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.875732:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a5a00/0x7ad3e1a8795769f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a8795769f1 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.875738:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b98af7800/0x7ad3e1a879576a1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576a14 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.875745:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576a37 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.876288:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b98af7800/0x7ad3e1a879576a1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576a14 expref: 16 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.876305:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b98af7800/0x7ad3e1a879576a1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576a14 expref: 16 pid: 5856 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850912.876321:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019620352:0@lo:104: 00000100:00100000:3.0:1788850912.876386:0:5853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788850912.876483:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a5a00/0x7ad3e1a8795769f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a8795769f1 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.876492:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a5a00/0x7ad3e1a8795769f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a8795769f1 expref: 16 pid: 5855 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850912.876501:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019620480:0@lo:104: 00010000:00010000:3.0:1788850912.876527:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b8168ea00/0x7ad3e1a8795769dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a8795769d5 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.876535:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b8168ea00/0x7ad3e1a8795769dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a8795769d5 expref: 16 pid: 5855 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850912.876542:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019620608:0@lo:104: 00010000:00010000:3.0:1788850912.876566:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a4600/0x7ad3e1a8795769b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a8795769ab expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.876573:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a4600/0x7ad3e1a8795769b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a8795769ab expref: 16 pid: 5853 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850912.876581:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019620736:0@lo:104: 00010000:00010000:3.0:1788850912.876614:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576981 expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.876622:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576988 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576981 expref: 16 pid: 5855 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850912.876631:0:5853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019620864:0@lo:104: 00000100:00100000:3.0:1788850912.876647:0:5853:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb39ac0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788850912.876760:0:5845:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788850912.876779:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850912.877158:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850912.877296:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850912.877320:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019620352 00000100:00100000:3.0:1788850912.877328:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019620352 00000100:00100000:3.0:1788850912.877365:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019620480 00000100:00100000:3.0:1788850912.877368:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019620480 00000100:00100000:3.0:1788850912.877412:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019620608 00000100:00100000:3.0:1788850912.877416:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019620608 00000100:00100000:3.0:1788850912.877432:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788850912.877440:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b91113450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+5:5853:x1875746019620352:12345-0@lo:104: 00010000:00010000:3.0:1788850912.877454:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879576a14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576a1b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.877537:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788850912.877543:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b91113450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+5:5853:x1875746019620352:12345-0@lo:104: Request processed in 105us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850912.877550:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788850912.877589:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788850912.877595:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+4:5853:x1875746019620480:12345-0@lo:104: 00010000:00010000:3.0:1788850912.877603:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b8168fa00/0x7ad3e1a8795769f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a8795769f8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.877637:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788850912.877649:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+4:5853:x1875746019620480:12345-0@lo:104: Request processed in 55us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850912.877656:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788850912.877669:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788850912.877675:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+3:5853:x1875746019620608:12345-0@lo:104: 00010000:00010000:3.0:1788850912.877683:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3400/0x7ad3e1a8795769d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a8795769dc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.877709:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788850912.877714:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+3:5853:x1875746019620608:12345-0@lo:104: Request processed in 40us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850912.877720:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788850912.877739:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788850912.877745:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879576a14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576a1b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.877753:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7e00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:3.0:1788850912.877757:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879576a14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576a1b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.877766:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879576a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576a1b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788850912.877774:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879576a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576a1b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850912.877802:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788850912.877831:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879576a14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576a1b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.877849:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788850912.877879:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879576a14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576a1b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.877887:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879576a14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576a1b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.877911:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788850912.877922:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b8168fa00/0x7ad3e1a8795769f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a8795769f8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.877929:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168fa00 already unused, calling callback (ffffffffc1ccbc20) 00010000:00010000:2.0:1788850912.878142:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788850912.878189:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019620992:0@lo:103: 00000100:00100000:2.0:1788850912.878234:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850912.878295:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019620992 00000100:00100000:2.0:1788850912.878299:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019620992 00010000:00010000:2.0:1788850912.878319:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b98af7800/0x7ad3e1a879576a1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576a14 expref: 17 pid: 5856 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850912.878341:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788850912.878347:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+17:3310:x1875746019620992:12345-0@lo:103: 00010000:00010000:2.0:1788850912.878357:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788850912.878362:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b98af7800/0x7ad3e1a879576a1b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576a14 expref: 17 pid: 5856 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850912.878373:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b98af7800/0x7ad3e1a879576a1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576a14 expref: 17 pid: 5856 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850912.878389:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788850912.878428:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d77480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+17:3310:x1875746019620992:12345-0@lo:103: Request processed in 81us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850912.878434:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788850912.878480:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019620992:0@lo:103: 10000000:00010000:3.0:1788850912.878689:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168fa00/0x7ad3e1a8795769f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a8795769f8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.878700:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b8168fa00/0x7ad3e1a8795769f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a8795769f8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788850912.878707:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168fa00/0x7ad3e1a8795769f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a8795769f8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850912.878713:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850912.879094:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af7800/0x7ad3e1a879576a1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576a14 expref: 16 pid: 5856 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850912.879109:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019620352:0@lo:104: 00000100:00100000:0.0:1788850912.879120:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019620480:0@lo:104: 00000100:00100000:0.0:1788850912.879129:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019620608:0@lo:104: 00010000:00010000:2.0:1788850912.879428:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b8168fa00/0x7ad3e1a8795769f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795769f8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850912.879435:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788850912.879451:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168fa00/0x7ad3e1a8795769f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795769f8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850912.879458:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b8168fa00/0x7ad3e1a8795769f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795769f8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850912.879551:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850912.879553:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850912.879555:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850912.879566:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019621120:0@lo:103: 00000100:00100000:2.0:1788850912.879608:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850912.879672:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019621120 00000100:00100000:2.0:1788850912.879677:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019621120 00010000:00010000:2.0:1788850912.879694:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a5a00/0x7ad3e1a8795769f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a8795769f1 expref: 16 pid: 5855 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850912.879715:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788850912.879721:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad19e61b-7666-4fee-85e9-385935a96ab4+16:3311:x1875746019621120:12345-0@lo:103: 00010000:00010000:2.0:1788850912.879730:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788850912.879734:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a5a00/0x7ad3e1a8795769f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a8795769f1 expref: 16 pid: 5855 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850912.879743:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a5a00/0x7ad3e1a8795769f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a8795769f1 expref: 16 pid: 5855 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850912.879756:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a5a00/0x7ad3e1a8795769f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a8795769f1 expref: 16 pid: 5855 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850912.879769:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788850912.880200:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850912.880203:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850912.880206:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850912.880266:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad19e61b-7666-4fee-85e9-385935a96ab4+15:3311:x1875746019621120:12345-0@lo:103: Request processed in 543us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850912.880274:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788850912.880380:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3400/0x7ad3e1a8795769d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a8795769dc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.880388:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a3400 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788850912.880391:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3400/0x7ad3e1a8795769d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a8795769dc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.880409:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3400/0x7ad3e1a8795769d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a8795769dc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850912.880431:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3400/0x7ad3e1a8795769d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a8795769dc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850912.880437:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850912.880469:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3400/0x7ad3e1a8795769d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795769dc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.880541:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850912.880560:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3400/0x7ad3e1a8795769d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795769dc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.880567:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3400/0x7ad3e1a8795769d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795769dc expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.880580:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850912.880582:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850912.880584:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850912.880595:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019621248:0@lo:103: 00000100:00100000:0.0:1788850912.880626:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850912.880665:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019621248 00000100:00100000:0.0:1788850912.880670:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019621248 00010000:00010000:0.0:1788850912.880688:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b8168ea00/0x7ad3e1a8795769dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a8795769d5 expref: 15 pid: 5855 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850912.880710:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788850912.880716:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99171f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+15:3308:x1875746019621248:12345-0@lo:103: 00010000:00010000:0.0:1788850912.880725:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850912.880730:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b8168ea00/0x7ad3e1a8795769dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a8795769d5 expref: 15 pid: 5855 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.880745:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b8168ea00/0x7ad3e1a8795769dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a8795769d5 expref: 15 pid: 5855 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.880757:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b8168ea00/0x7ad3e1a8795769dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a8795769d5 expref: 15 pid: 5855 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.880806:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850912.880836:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99171f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:3308:x1875746019621248:12345-0@lo:103: Request processed in 120us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850912.880843:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788850912.881169:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019621248:0@lo:103: 00000100:00100000:3.0:1788850912.881255:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019621120:0@lo:103: 00000100:00100000:1.0:1788850912.881426:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850912.881557:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019620736 00000100:00100000:3.0:1788850912.881563:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019620736 00000100:00100000:3.0:1788850912.881586:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019620864 00000100:00100000:3.0:1788850912.881596:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019620864 00000100:00100000:3.0:1788850912.881612:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788850912.881619:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+4:5853:x1875746019620736:12345-0@lo:104: 00010000:00010000:3.0:1788850912.881629:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a8795769ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a8795769b2 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.881686:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788850912.881691:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+4:5853:x1875746019620736:12345-0@lo:104: Request processed in 74us (4396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850912.881697:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788850912.881709:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788850912.881714:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+3:5853:x1875746019620864:12345-0@lo:104: 00010000:00010000:3.0:1788850912.881722:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4c00/0x7ad3e1a879576981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576988 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.881751:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788850912.881756:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+3:5853:x1875746019620864:12345-0@lo:104: Request processed in 42us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850912.881762:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788850912.881776:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788850912.881806:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a8795769ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a8795769b2 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.881813:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168e000 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:3.0:1788850912.881817:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a8795769ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a8795769b2 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.881825:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a8795769ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a8795769b2 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788850912.881845:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a8795769ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a8795769b2 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850912.881863:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788850912.881886:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a8795769ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795769b2 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.881901:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788850912.881913:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a8795769ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795769b2 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.882096:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a8795769ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795769b2 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.882109:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788850912.882112:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4c00/0x7ad3e1a879576981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576988 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.882118:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4c00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:3.0:1788850912.882121:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4c00/0x7ad3e1a879576981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576988 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.882128:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4c00/0x7ad3e1a879576981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576988 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788850912.882134:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4c00/0x7ad3e1a879576981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576988 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850912.882140:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788850912.882159:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4c00/0x7ad3e1a879576981 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576988 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.882165:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788850912.882178:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4c00/0x7ad3e1a879576981 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576988 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.882185:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4c00/0x7ad3e1a879576981 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576988 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850912.882204:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788850912.882214:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019621504:0@lo:103: 00000100:00100000:3.0:1788850912.882246:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788850912.882278:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850912.882280:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850912.882282:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850912.882426:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850912.882553:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019621504 00000100:00100000:0.0:1788850912.882559:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019621504 00010000:00010000:0.0:1788850912.882578:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576988 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576981 expref: 14 pid: 5855 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850912.882608:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788850912.882614:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+14:3311:x1875746019621504:12345-0@lo:103: 00010000:00010000:0.0:1788850912.882625:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850912.882630:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576988 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576981 expref: 14 pid: 5855 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.882640:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576988 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576981 expref: 14 pid: 5855 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.882656:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850912.882687:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+14:3311:x1875746019621504:12345-0@lo:103: Request processed in 73us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850912.882702:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788850912.882727:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019621376:0@lo:103: 00000100:00100000:0.0:1788850912.882751:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850912.882808:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019621504:0@lo:103: 00000100:00100000:0.0:1788850912.882826:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019621376 00000100:00100000:0.0:1788850912.882829:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019621376 00010000:00010000:0.0:1788850912.882842:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a4600/0x7ad3e1a8795769b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a8795769ab expref: 14 pid: 5853 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850912.883274:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788850912.883282:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99172d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:3309:x1875746019621376:12345-0@lo:103: 00010000:00010000:0.0:1788850912.883291:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850912.883296:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a4600/0x7ad3e1a8795769b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a8795769ab expref: 14 pid: 5853 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.883307:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a4600/0x7ad3e1a8795769b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a8795769ab expref: 14 pid: 5853 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.883320:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576a37 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.883329:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576a37 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.883345:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576a37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.883354:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576a37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.883371:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576a37 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.883379:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576a37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.883384:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788850912.883388:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576a37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.883397:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576a37 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.883418:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576a37 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.883428:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850912.883480:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99172d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:3309:x1875746019621376:12345-0@lo:103: Request processed in 192us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850912.883486:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788850912.883600:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019621376:0@lo:103: 00010000:00010000:0.0:1788850912.883698:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a4600/0x7ad3e1a8795769b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a8795769ab expref: 13 pid: 5853 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850912.883711:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019620736:0@lo:104: 00010000:00010000:0.0:1788850912.883721:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576988 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576981 expref: 12 pid: 5855 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850912.883729:0:5853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5853:1875746019620864:0@lo:104: 00010000:00010000:0.0:1788850912.883752:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576a37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.883767:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576a37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.883775:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576a37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.884247:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576a37 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788850912.884265:0:5853:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788850912.940585:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+11:7638:x1875746019620224:12345-0@lo:253: Request processed in 94998us (97959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850912.940601:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788850912.940723:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019620224:0@lo:253: 10000000:01000000:0.0:1788850912.940742:0:7638:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788850912.940746:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788850912.940748:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788850912.940750:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788850912.940752:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788850912.940753:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788850912.940755:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788850912.940756:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788850912.940758:0:7638:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788850912.940759:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788850912.940761:0:7638:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788850912.940805:0:7638:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a9b866a7000 from lustre-OST0001 10000000:01000000:0.0:1788850912.940837:0:7638:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788850912.940840:0:7638:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788850912.940861:0:7638:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a9b90470000 local copy 10000000:01000000:0.0:1788850912.940866:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788850912.941045:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7400/0x7ad3e1a879576a3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.941058:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7400/0x7ad3e1a879576a3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.941088:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7400/0x7ad3e1a879576a3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850912.941109:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019621632:0@lo:101: 00000100:00100000:0.0:1788850912.941153:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850912.941262:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf443c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788850912.941585:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019621632 00000100:00100000:2.0:1788850912.941602:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019621632 00000100:00100000:2.0:1788850912.941685:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788850912.941696:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+11:7638:x1875746019621632:12345-0@lo:101: 00010000:00010000:2.0:1788850912.941709:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850912.941726:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a2400/0x7ad3e1a879576a45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576a3e expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850912.941750:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a2400/0x7ad3e1a879576a45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576a3e expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850912.941762:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a2400/0x7ad3e1a879576a45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576a3e expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850912.941770:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a2400, rc 0) 00000100:00100000:2.0:1788850912.941836:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:7638:x1875746019621632:12345-0@lo:101: Request processed in 143us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850912.941842:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788850912.941947:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019621632:0@lo:101: 00010000:00010000:1.0:1788850912.941961:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7400/0x7ad3e1a879576a3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7ad3e1a879576a45 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850912.941970:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7400/0x7ad3e1a879576a3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7ad3e1a879576a45 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850912.942077:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019621760:0@lo:501: 00000100:00100000:1.0:1788850912.942107:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850912.942564:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905fd600 going to sleep for 11 seconds 00000100:00100000:0.0:1788850912.942644:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019621760 00000100:00100000:0.0:1788850912.942649:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019621760 00000100:00100000:0.0:1788850912.942677:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788850912.942684:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+12:7638:x1875746019621760:12345-0@lo:501: 00000100:00100000:0.0:1788850912.943277:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+12:7638:x1875746019621760:12345-0@lo:501: Request processed in 590us (1165us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788850912.943287:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788850912.943411:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019621760:0@lo:501: 10000000:01000000:1.0:1788850912.943430:0:7638:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788850912.943465:0:7638:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788850912.943542:0:7638:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7400/0x7ad3e1a879576a3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7ad3e1a879576a45 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850912.943553:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7400/0x7ad3e1a879576a3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7ad3e1a879576a45 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850912.943561:0:7638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7400/0x7ad3e1a879576a3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7ad3e1a879576a45 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850912.943619:0:7638:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788850912.943644:0:7638:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a9b866a7000 10000000:01000000:1.0:1788850912.943649:0:7638:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788850912.943654:0:7638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788850912.943657:0:7638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788850912.943661:0:7638:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788850912.943672:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788850912.943697:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e600/0x7ad3e1a879576a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850912.943704:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e600/0x7ad3e1a879576a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850912.943712:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e600/0x7ad3e1a879576a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850912.943727:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019621888:0@lo:101: 00000100:00100000:1.0:1788850912.943760:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850912.943813:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905fd540 going to sleep for 11 seconds 00000100:00100000:2.0:1788850912.944124:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019621888 00000100:00100000:2.0:1788850912.944130:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019621888 00000100:00100000:2.0:1788850912.944171:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788850912.944179:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:7638:x1875746019621888:12345-0@lo:101: 00010000:00010000:2.0:1788850912.944189:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850912.944201:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a2a00/0x7ad3e1a879576a53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576a4c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850912.944222:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a2a00/0x7ad3e1a879576a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576a4c expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850912.944232:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a2a00/0x7ad3e1a879576a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576a4c expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850912.944251:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a2a00, rc 0) 00000100:00100000:2.0:1788850912.944298:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019621888:12345-0@lo:101: Request processed in 120us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850912.944304:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788850912.944380:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019621888:0@lo:101: 00010000:00010000:3.0:1788850912.944394:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e600/0x7ad3e1a879576a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576a53 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.944413:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e600/0x7ad3e1a879576a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576a53 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850912.944566:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019622016:0@lo:501: 00000100:00100000:3.0:1788850912.944596:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850912.944621:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb39accc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788850912.944682:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622016 00000100:00100000:2.0:1788850912.944686:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622016 00000100:00100000:2.0:1788850912.944716:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788850912.944722:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019622016:12345-0@lo:501: 00000100:00100000:2.0:1788850912.945204:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019622016:12345-0@lo:501: Request processed in 481us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850912.945212:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788850912.945280:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019622016:0@lo:501: 00000100:00100000:3.0:1788850912.945313:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019622144:0@lo:503: 00000100:00100000:3.0:1788850912.945352:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850912.945382:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb39accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788850912.945579:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622144 00000100:00100000:1.0:1788850912.945585:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622144 00000100:00100000:1.0:1788850912.945619:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788850912.945626:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019622144:12345-0@lo:503: 00000100:00100000:1.0:1788850912.945803:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019622144:12345-0@lo:503: Request processed in 156us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850912.945809:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788850912.945899:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019622144:0@lo:503: 00000040:00080000:3.0:1788850912.946294:0:7638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788850912.946357:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019622272:0@lo:502: 00000100:00100000:3.0:1788850912.946409:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850912.946440:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb39accc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788850912.946685:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622272 00000100:00100000:1.0:1788850912.946691:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622272 00000100:00100000:1.0:1788850912.946726:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788850912.946734:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019622272:12345-0@lo:502: 00000100:00100000:1.0:1788850912.947293:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019622272:12345-0@lo:502: Request processed in 558us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850912.947301:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:0.0:1788850912.947388:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788850912.947409:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7400/0x7ad3e1a879576a3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7ad3e1a879576a45 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.947420:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7400 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788850912.947425:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7400/0x7ad3e1a879576a3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7ad3e1a879576a45 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.947435:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7400/0x7ad3e1a879576a3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7ad3e1a879576a45 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850912.947442:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7400/0x7ad3e1a879576a3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7ad3e1a879576a45 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850912.947449:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850912.947495:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7400/0x7ad3e1a879576a3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7ad3e1a879576a45 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.947503:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850912.947534:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7400/0x7ad3e1a879576a3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7ad3e1a879576a45 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.947542:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7400/0x7ad3e1a879576a3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7ad3e1a879576a45 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.947555:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850912.947557:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850912.947559:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850912.947665:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019622400:0@lo:103: 00000100:00100000:1.0:1788850912.947706:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850912.947874:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622400 00000100:00100000:0.0:1788850912.947880:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622400 00000100:00100000:0.0:1788850912.948192:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788850912.948200:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:3311:x1875746019622400:12345-0@lo:103: 00010000:00010000:0.0:1788850912.948212:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850912.948227:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a2400/0x7ad3e1a879576a45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ad3e1a879576a3e expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.948239:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850912.948352:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:3311:x1875746019622400:12345-0@lo:103: Request processed in 153us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850912.948359:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788850912.948532:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019622400:0@lo:103: 00000100:00100000:3.0:1788850912.948614:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019622272:0@lo:502: 00000040:00080000:3.0:1788850912.949222:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788850912.949288:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788850912.949324:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788850912.949369:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788850912.949419:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788850912.949454:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788850912.949563:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019622528:0@lo:502: 00000100:00100000:3.0:1788850912.949627:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850912.949729:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb39accc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788850912.950130:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622528 00000100:00100000:2.0:1788850912.950138:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622528 00000100:00100000:2.0:1788850912.950212:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788850912.950220:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:7638:x1875746019622528:12345-0@lo:502: 00000100:00100000:2.0:1788850912.950468:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+12:7638:x1875746019622528:12345-0@lo:502: Request processed in 248us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850912.950531:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788850912.950620:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019622528:0@lo:502: 00000040:00080000:0.0:1788850912.950725:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788850912.950737:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788850912.951568:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788850912.951579:0:7647:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1788850912.951591:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850912.951594:0:7647:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788850912.951601:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788850912.951616:0:7647:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a9b904719c0) 00000020:00000080:0.0:1788850912.951646:0:7647:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788850912.951650:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788850912.951711:0:7647:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a9b866a7000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788850912.951718:0:7647:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788850912.951724:0:7647:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7ad3e1a879576a61 00010000:00010000:1.0:1788850912.957408:0:7647:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788850912.958240:0:7647:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788850912.962528:0:7647:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788850912.963044:0:7647:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788850912.969845:0:7647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788850912.970708:0:7647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788850912.972818:0:7647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788850912.972831:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850912.972837:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850912.972839:0:7647:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788850912.972842:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788850912.972853:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850912.972854:0:7647:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788850912.972858:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788850912.972860:0:7647:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788850912.975229:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850912.975242:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850912.975244:0:7647:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788850912.975252:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788850912.981226:0:7638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788850912.981278:0:7638:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788850912.981344:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e600/0x7ad3e1a879576a4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576a53 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850912.981359:0:7638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e600/0x7ad3e1a879576a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576a53 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850912.981369:0:7638:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9b866a7000 from 1 10000000:01000000:1.0:1788850912.981372:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788850912.981425:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f000/0x7ad3e1a879576a68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850912.981433:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f000/0x7ad3e1a879576a68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850912.981444:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f000/0x7ad3e1a879576a68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850912.981527:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019622656:0@lo:101: 00000100:00100000:1.0:1788850912.981606:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850912.981663:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98a219c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850912.982225:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622656 00000100:00100000:0.0:1788850912.982235:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622656 00000100:00100000:0.0:1788850912.982289:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788850912.982300:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+12:7638:x1875746019622656:12345-0@lo:101: 00010000:00010000:0.0:1788850912.982315:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850912.982330:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576a6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576a68 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.982360:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576a6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576a68 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.982385:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576a6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576a68 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.982394:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7400, rc 0) 00000100:00100000:0.0:1788850912.982458:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019622656:12345-0@lo:101: Request processed in 160us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850912.982465:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788850912.982652:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019622656:0@lo:101: 00010000:00010000:0.0:1788850912.982668:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f000/0x7ad3e1a879576a68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576a6f expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.982677:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f000/0x7ad3e1a879576a68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576a6f expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850912.982777:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019622784:0@lo:501: 00000100:00100000:0.0:1788850912.982829:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850912.983117:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622784 00000100:00100000:3.0:1788850912.983123:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622784 00000100:00100000:3.0:1788850912.983154:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788850912.983161:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019622784:12345-0@lo:501: 00000100:00100000:3.0:1788850912.983418:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019622784:12345-0@lo:501: Request processed in 257us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850912.983425:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788850912.984329:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87d6dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850912.984360:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019622784:0@lo:501: 00000100:00100000:0.0:1788850912.984415:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019622912:0@lo:503: 00000100:00100000:0.0:1788850912.985154:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850912.986059:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87d6dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850912.987560:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019622912 00000100:00100000:3.0:1788850912.987593:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019622912 00000100:00100000:2.0:1788850912.987757:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788850912.987768:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019622912:12345-0@lo:503: 00000100:00100000:2.0:1788850912.988684:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019622912:12345-0@lo:503: Request processed in 915us (3529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850912.988695:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788850912.989327:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019622912:0@lo:503: 00000040:00080000:0.0:1788850912.989816:0:7638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788850912.990220:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99173b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019623040:0@lo:502: 00000100:00100000:0.0:1788850912.990286:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850912.990374:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c09c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788850912.990424:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623040 00000100:00100000:3.0:1788850912.990431:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623040 00000100:00100000:3.0:1788850912.990560:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788850912.990571:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019623040:12345-0@lo:502: 00000100:00100000:3.0:1788850912.990824:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019623040:12345-0@lo:502: Request processed in 255us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850912.990831:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788850912.991164:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99173b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019623040:0@lo:502: 00000040:00080000:1.0:1788850912.991461:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788850912.991525:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788850912.991552:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d74a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019623168:0@lo:502: 00000100:00100000:1.0:1788850912.991595:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850912.991830:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98a21d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788850912.992192:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623168 00000100:00100000:0.0:1788850912.992201:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623168 00000100:00100000:0.0:1788850912.992237:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788850912.992246:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019623168:12345-0@lo:502: 00000100:00100000:0.0:1788850912.992439:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019623168:12345-0@lo:502: Request processed in 194us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850912.992447:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788850912.992509:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d74a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019623168:0@lo:502: 00000040:00080000:0.0:1788850912.992619:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788850912.992632:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788850912.993718:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850912.993731:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850912.993733:0:7651:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788850912.993741:0:7651:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a9b866a7000 00000020:00000080:1.0:1788850912.993744:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788850912.993766:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850912.993769:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850912.993771:0:7651:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788850912.993774:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788850912.994596:0:7638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788850912.994625:0:7638:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788850912.994681:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f000/0x7ad3e1a879576a68 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576a6f expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.994693:0:7638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f000/0x7ad3e1a879576a68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576a6f expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850912.994745:0:7638:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788850912.994748:0:7638:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a9b866a7000 10000000:01000000:0.0:1788850912.994751:0:7638:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a9b866a7000 10000000:01000000:0.0:1788850912.994756:0:7638:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788850912.994762:0:7638:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a9b866a7000 from 1 10000000:01000000:0.0:1788850912.994764:0:7638:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788850912.994827:0:7638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7800/0x7ad3e1a879576a76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.994837:0:7638:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7800/0x7ad3e1a879576a76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850912.994872:0:7638:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7800/0x7ad3e1a879576a76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850912.994901:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019623296:0@lo:101: 00000100:00100000:0.0:1788850912.995265:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850912.995303:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf44240 going to sleep for 11 seconds 00000100:00100000:3.0:1788850912.995458:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623296 00000100:00100000:3.0:1788850912.995466:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623296 00000100:00100000:3.0:1788850912.995527:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788850912.995538:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019623296:12345-0@lo:101: 00010000:00010000:3.0:1788850912.995551:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850912.995564:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576a7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576a76 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.995590:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576a76 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.995601:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576a76 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850912.995610:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4c00, rc 0) 00000100:00100000:3.0:1788850912.995694:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:7638:x1875746019623296:12345-0@lo:101: Request processed in 158us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850912.995701:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788850912.996233:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019623296:0@lo:101: 00010000:00010000:1.0:1788850912.996250:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7800/0x7ad3e1a879576a76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576a7d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850912.996260:0:7638:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7800/0x7ad3e1a879576a76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576a7d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850912.996384:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019623424:0@lo:501: 00000100:00100000:1.0:1788850912.996429:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850912.996500:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98a21840 going to sleep for 11 seconds 00000100:00100000:2.0:1788850912.996581:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623424 00000100:00100000:2.0:1788850912.996586:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623424 00000100:00100000:2.0:1788850912.996656:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788850912.996665:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+14:7638:x1875746019623424:12345-0@lo:501: 00000100:00100000:2.0:1788850912.997368:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+14:7638:x1875746019623424:12345-0@lo:501: Request processed in 701us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850912.997377:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788850912.997448:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019623424:0@lo:501: 00000100:00100000:1.0:1788850912.997500:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019623552:0@lo:503: 00000100:00100000:1.0:1788850912.997538:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850912.997736:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98a21840 going to sleep for 11 seconds 00000100:00100000:3.0:1788850912.997893:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623552 00000100:00100000:3.0:1788850912.997899:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623552 00000100:00100000:3.0:1788850912.998148:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788850912.998157:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:7638:x1875746019623552:12345-0@lo:503: 00000100:00100000:3.0:1788850912.998337:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:7638:x1875746019623552:12345-0@lo:503: Request processed in 182us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850912.998344:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788850912.998425:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019623552:0@lo:503: 00000040:00080000:1.0:1788850912.998707:0:7638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788850912.998770:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019623680:0@lo:502: 00000100:00100000:1.0:1788850912.998861:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850912.998896:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98a21840 going to sleep for 11 seconds 00000100:00100000:3.0:1788850912.999223:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623680 00000100:00100000:3.0:1788850912.999229:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623680 00000100:00100000:3.0:1788850912.999251:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788850912.999258:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:7638:x1875746019623680:12345-0@lo:502: 00000100:00100000:3.0:1788850912.999448:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:7638:x1875746019623680:12345-0@lo:502: Request processed in 189us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850912.999455:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788850912.999578:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019623680:0@lo:502: 00000040:00080000:1.0:1788850912.999882:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788850913.000167:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788850913.000201:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788850913.000249:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788850913.000285:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788850913.000332:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788850913.000370:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788850913.000415:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788850913.000464:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788850913.000575:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788850913.000605:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788850913.000650:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788850913.000686:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788850913.000739:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788850913.000830:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788850913.001126:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788850913.001163:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788850913.001223:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788850913.001260:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788850913.001292:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788850913.001350:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788850913.001385:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788850913.001432:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788850913.001620:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788850913.001662:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788850913.001697:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788850913.001746:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788850913.004125:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788850913.004233:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788850913.004329:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788850913.004363:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788850913.004396:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788850913.004444:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788850913.005198:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788850913.005244:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788850913.005289:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788850913.005321:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788850913.005380:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019623808:0@lo:502: 00000100:00100000:1.0:1788850913.005610:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850913.005660:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98a21840 going to sleep for 11 seconds 00000100:00100000:2.0:1788850913.005738:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623808 00000100:00100000:2.0:1788850913.005747:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623808 00000100:00100000:2.0:1788850913.005819:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788850913.005829:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+14:7638:x1875746019623808:12345-0@lo:502: 00000100:00100000:2.0:1788850913.006332:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+14:7638:x1875746019623808:12345-0@lo:502: Request processed in 503us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850913.006340:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788850913.006416:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019623808:0@lo:502: 00000040:00080000:2.0:1788850913.006575:0:7638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788850913.006587:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788850913.007715:0:7652:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788850913.007739:0:7652:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a9bc1e14d40) 00000020:00000080:2.0:1788850913.007760:0:7652:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788850913.008350:0:7652:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a9b866a7000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788850913.008357:0:7652:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a9b866a7000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788850913.008360:0:7652:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a9b866a7000 3 00010000:00080000:3.0:1788850913.008393:0:7652:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a9b86759000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.106@tcp at head 00010000:00010000:3.0:1788850913.011336:0:7652:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788850913.011631:0:7652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788850913.011676:0:7652:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788850913.011691:0:7652:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7ad3e1a879576a8b 00000100:00080000:3.0:1788850913.011703:0:7652:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788850913.011715:0:7652:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a9b86759000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1788850913.011761:0:7652:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9bb3665500 x1875746019623936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788850913.011808:0:7652:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788850913.012261:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875746019623936:0@lo:38: 00000100:00100000:1.0:1788850913.012341:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850913.012606:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019623936 00000100:00100000:3.0:1788850913.012614:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019623936 00000100:00100000:3.0:1788850913.012657:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788850913.012665:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1875746019623936:12345-0@lo:38: 00010000:00080000:3.0:1788850913.012701:0:5862:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:3.0:1788850913.012732:0:5862:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7ad3e1a879576a92 00000004:00100000:3.0:1788850913.012746:0:5862:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788850913.012812:0:5862:0:(import.c:65:import_set_state_nolock()) ffff8a9bb44b1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788850913.012880:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875746019623936:12345-0@lo:38: Request processed in 216us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850913.012897:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788850913.013193:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb3665500 x1875746019623936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788850923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850913.013205:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788850913.013212:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788850913.013220:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788850913.013224:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788850913.013226:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b86759000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788850913.013233:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875746019623936:0@lo:38: 00000040:00080000:3.0:1788850913.013388:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:1.0:1788850913.013695:0:7653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d74380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7653:1875746019624064:0@lo:901: 00000100:00100000:1.0:1788850913.013736:0:7653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850913.013763:0:7653:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98a219c0 going to sleep for 11 seconds 00000020:01000000:1.0:1788850913.014172:0:7638:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788850913.014203:0:7638:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788850913.014223:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7800/0x7ad3e1a879576a76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576a7d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850913.014250:0:7638:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7800/0x7ad3e1a879576a76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576a7d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788850913.014308:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788850913.014309:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788850913.014311:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788850913.014312:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788850913.014313:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788850913.014315:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788850913.014316:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788850913.014318:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788850913.014319:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788850913.014321:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788850913.014322:0:7638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788850913.014327:0:7638:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788850913.014329:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788850913.014330:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788850913.014331:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788850913.014333:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788850913.014334:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788850913.014335:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788850913.014336:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788850913.014337:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788850913.014338:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788850913.014339:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788850913.014340:0:7638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788850913.014359:0:7638:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788850913.014367:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019624192:0@lo:253: 00000100:00100000:1.0:1788850913.014435:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850913.014463:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c096c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850913.014625:0:5872:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624064 00000100:00100000:3.0:1788850913.014632:0:5872:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624064 00000100:00100000:3.0:1788850913.014689:0:5872:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788850913.014698:0:5872:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7653:x1875746019624064:12345-0@lo:901: 00000100:00100000:3.0:1788850913.015460:0:5872:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7653:x1875746019624064:12345-0@lo:901: Request processed in 759us (1719us total) trans 0 rc 0/0 00000100:00080000:1.0:1788850913.015722:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788850913.016188:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624192 00000100:00100000:2.0:1788850913.016196:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624192 00000100:00100000:2.0:1788850913.016279:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788850913.016289:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+14:7638:x1875746019624192:12345-0@lo:253: 20000000:01000000:2.0:1788850913.016318:0:5853:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788850913.016333:0:5853:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788850913.017126:0:5872:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788850913.017264:0:7653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bc1d74380 x1875746019624064/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788850929 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850913.017280:0:7653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d74380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7653:1875746019624064:0@lo:901: 00010000:00010000:3.0:1788850913.042391:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1788850913.062252:0:5853:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788850913.062305:0:5853:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788850913.066853:0:5877:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788850913.066865:0:5877:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788850913.066898:0:5877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9b814a4000/0x7ad3e1a879576a99 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850913.066925:0:5877:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a8795769ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a8795769e3 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850913.066941:0:5877:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9b814a4000/0x7ad3e1a879576a99 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850913.066996:0:5877:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a8795769ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a8795769e3 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850913.067012:0:5877:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a8795769ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a8795769e3 expref: 14 pid: 5855 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850913.067028:0:5877:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1875746019624320:0@lo:104: 00000100:00100000:3.0:1788850913.067093:0:5877:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850913.067132:0:5877:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b82a8ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788850913.067420:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624320 00000100:00100000:1.0:1788850913.067429:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624320 00000100:00100000:1.0:1788850913.067540:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788850913.067551:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3667b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+3:5877:x1875746019624320:12345-0@lo:104: 00010000:00010000:1.0:1788850913.067564:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a8795769e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a8795769ea expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850913.067626:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788850913.067633:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3667b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+3:5877:x1875746019624320:12345-0@lo:104: Request processed in 85us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850913.067639:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788850913.067710:0:5877:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5877:1875746019624320:0@lo:104: 00010000:00010000:3.0:1788850913.067732:0:5877:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9b814a4000/0x7ad3e1a879576a99 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.068577:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788850913.068587:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a8795769e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a8795769ea expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.068607:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ec00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:2.0:1788850913.068612:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a8795769e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a8795769ea expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.068620:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a8795769e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a8795769ea expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788850913.068627:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a8795769e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a8795769ea expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850913.068633:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788850913.068672:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a8795769e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795769ea expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.068679:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788850913.068703:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a8795769e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795769ea expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.068711:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a8795769e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795769ea expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.068728:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850913.068729:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850913.068731:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850913.068738:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788850913.068751:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019624448:0@lo:103: 00000100:00100000:2.0:1788850913.068828:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850913.069252:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624448 00000100:00100000:2.0:1788850913.069259:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624448 00010000:00010000:2.0:1788850913.069290:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a8795769ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a8795769e3 expref: 15 pid: 5855 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850913.069322:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788850913.069331:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86787c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+15:3309:x1875746019624448:12345-0@lo:103: 00010000:00010000:2.0:1788850913.069343:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788850913.069348:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a8795769ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a8795769e3 expref: 15 pid: 5855 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.069359:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a8795769ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a8795769e3 expref: 15 pid: 5855 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.069373:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a8795769ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a8795769e3 expref: 15 pid: 5855 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.069387:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9b814a4000/0x7ad3e1a879576a99 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.069405:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a4000/0x7ad3e1a879576a99 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788850913.069421:0:5848:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006508595s 00010000:00010000:2.0:1788850913.069426:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b814a4000/0x7ad3e1a879576a99 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.069434:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b814a4000/0x7ad3e1a879576a99 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.069442:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9b814a4000/0x7ad3e1a879576a99 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.069449:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9b814a4000/0x7ad3e1a879576a99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.069460:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4000 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788850913.069464:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9b814a4000/0x7ad3e1a879576a99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.069580:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9b814a4000/0x7ad3e1a879576a99 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.069598:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9b814a4000/0x7ad3e1a879576a99 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850913.069609:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788850913.069697:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86787c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+14:3309:x1875746019624448:12345-0@lo:103: Request processed in 367us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850913.069703:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788850913.070506:0:5877:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9b814a4000/0x7ad3e1a879576a99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850913.070519:0:5877:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9b814a4000/0x7ad3e1a879576a99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850913.070538:0:5877:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a4000/0x7ad3e1a879576a99 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850913.072718:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:7638:x1875746019624192:12345-0@lo:253: Request processed in 56420us (58272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850913.072732:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788850913.072857:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ad19e61b-7666-4fee-85e9-385935a96ab4:7638:1875746019624192:0@lo:253: 10000000:01000000:1.0:1788850913.072875:0:7638:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788850913.072879:0:7638:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788850913.072881:0:7638:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788850913.072882:0:7638:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788850913.072884:0:7638:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788850913.072893:0:7638:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788850913.072895:0:7638:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788850913.072896:0:7638:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788850913.072898:0:7638:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788850913.072899:0:7638:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788850913.072901:0:7638:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788850913.072902:0:7638:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788850913.073237:0:7638:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788850913.075701:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019624448:0@lo:103: 00080000:10000000:0.0:1788850913.082736:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788850913.082945:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788850913.083685:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788850913.084161:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788850913.084435:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788850913.085213:0:7638:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788850913.087349:0:7638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788850913.340470:0:7638:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788850913.340478:0:7638:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788850913.340516:0:7638:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788850913.340577:0:7638:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788850913.340592:0:7638:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788850913.340622:0:7638:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788850914.067483:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850915.089932:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850916.117216:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850917.140326:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850917.905946:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019624576:0@lo:13: 00000100:00100000:0.0:1788850917.906025:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850917.906093:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624576 00000100:00100000:3.0:1788850917.906104:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624576 00000100:00080000:1.0:1788850917.906143:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788850917.906175:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788850917.906200:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019624576:12345-0@lo:13: 00002000:00000024:3.0:1788850917.906243:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788850917.915091:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019624576:12345-0@lo:13: Request processed in 8885us (9055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850917.915108:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788850917.917187:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc1d77480 x1875746019624576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850933 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850917.917294:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019624576:0@lo:13: 00010000:00010000:3.0:1788850918.162405:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850918.418727:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019624704:0@lo:400: 00000100:00100000:0.0:1788850918.418816:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850918.418887:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019625216:0@lo:400: 00000100:00100000:0.0:1788850918.418914:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850918.418947:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788850918.418953:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019624832:0@lo:400: 00000100:00100000:0.0:1788850918.418974:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850918.419001:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019624960:0@lo:400: 00000100:00100000:0.0:1788850918.419023:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850918.419039:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788850918.419045:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019625088:0@lo:400: 00000100:00100000:0.0:1788850918.419067:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850918.419283:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625216 00000100:00100000:0.0:1788850918.419290:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625216 00000100:00100000:0.0:1788850918.419343:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624832 00000100:00100000:0.0:1788850918.419346:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624832 00000100:00100000:0.0:1788850918.419358:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624960 00000100:00100000:0.0:1788850918.419361:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624960 00000100:00100000:0.0:1788850918.419376:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788850918.419384:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019625216:12345-0@lo:400: 00000100:00100000:0.0:1788850918.419434:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019625216:12345-0@lo:400: Request processed in 50us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850918.419441:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788850918.419459:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788850918.419465:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019624832:12345-0@lo:400: 00000100:00100000:0.0:1788850918.419491:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019624832:12345-0@lo:400: Request processed in 27us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850918.419497:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788850918.419518:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788850918.419525:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019624960:12345-0@lo:400: 00000100:00100000:0.0:1788850918.419556:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019624960:12345-0@lo:400: Request processed in 31us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850918.419568:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788850918.419590:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625088 00000100:00100000:0.0:1788850918.419593:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625088 00000100:00100000:0.0:1788850918.419616:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788850918.419622:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019625088:12345-0@lo:400: 00000100:00100000:0.0:1788850918.419652:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99173480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019625088:12345-0@lo:400: Request processed in 30us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850918.419658:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788850918.419672:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788850918.419703:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b99173b80 x1875746019625088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850918.419717:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019625088:0@lo:400: 00010000:00080000:0.0:1788850918.419727:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b99170700 x1875746019624960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850918.419740:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019624960:0@lo:400: 00010000:00080000:0.0:1788850918.419860:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b99172d80 x1875746019624832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850918.420347:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019624704 00000100:00100000:3.0:1788850918.420353:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019624704 00000100:00100000:3.0:1788850918.420384:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788850918.420391:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+13:3310:x1875746019624704:12345-0@lo:400: 00000100:00100000:3.0:1788850918.420434:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+13:3310:x1875746019624704:12345-0@lo:400: Request processed in 44us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850918.420440:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788850918.420726:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019624832:0@lo:400: 00000100:00100000:0.0:1788850918.420739:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019624704:0@lo:400: 00010000:00080000:0.0:1788850918.420749:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b99171c00 x1875746019625216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850918.420758:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019625216:0@lo:400: 00010000:00010000:2.0:1788850919.186465:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850920.212053:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788850920.362863:0:7996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788850921.240845:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788850922.002772:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788850922.002801:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a9ba049f800 from 30 10000000:01000000:0.0:1788850922.002807:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788850922.002848:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6c00/0x7ad3e1a879576aa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850922.002860:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6c00/0x7ad3e1a879576aa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850922.002870:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6c00/0x7ad3e1a879576aa0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850922.002891:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019625344:0@lo:101: 00000100:00100000:0.0:1788850922.003049:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850922.003141:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625344 00000100:00100000:1.0:1788850922.003149:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625344 00000100:00100000:1.0:1788850922.003216:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788850922.003236:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:5858:x1875746019625344:12345-0@lo:101: 00010000:00010000:1.0:1788850922.003250:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850922.003263:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879576aa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576aa0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850922.003295:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879576aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576aa0 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850922.003306:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879576aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576aa0 expref: 14 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850922.003314:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168ee00, rc 0) 00000100:00100000:1.0:1788850922.003348:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019625344:12345-0@lo:101: Request processed in 124us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850922.003354:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788850922.003403:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b906a7180 going to sleep for 11 seconds 00000100:00100000:1.0:1788850922.003423:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019625344:0@lo:101: 00010000:00010000:1.0:1788850922.003437:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6c00/0x7ad3e1a879576aa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576aa7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850922.003446:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6c00/0x7ad3e1a879576aa0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576aa7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850922.003496:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019625472:0@lo:501: 00000100:00100000:1.0:1788850922.003520:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850922.003532:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b957929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.003882:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625472 00000100:00100000:3.0:1788850922.003887:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625472 00000100:00100000:3.0:1788850922.003922:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788850922.003929:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019625472:12345-0@lo:501: 00000100:00100000:3.0:1788850922.004460:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019625472:12345-0@lo:501: Request processed in 530us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850922.004467:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788850922.004510:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019625472:0@lo:501: 00000100:00100000:3.0:1788850922.004544:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019625600:0@lo:503: 00000100:00100000:3.0:1788850922.004584:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850922.004606:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b82a8a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.004617:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625600 00000100:00100000:3.0:1788850922.004621:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625600 00000100:00100000:3.0:1788850922.004649:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788850922.004656:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019625600:12345-0@lo:503: 00000100:00100000:3.0:1788850922.006344:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019625600:12345-0@lo:503: Request processed in 1679us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850922.006359:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788850922.010088:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019625600:0@lo:503: 00000100:00100000:3.0:1788850922.027635:0:8072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8072:1875746019625728:0@lo:502: 00000100:00100000:3.0:1788850922.027723:0:8072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850922.027759:0:8072:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b82a8ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788850922.027873:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625728 00000100:00100000:1.0:1788850922.027881:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625728 00000100:00100000:1.0:1788850922.027942:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788850922.027953:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+14:8072:x1875746019625728:12345-0@lo:502: 00000100:00100000:1.0:1788850922.028362:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+14:8072:x1875746019625728:12345-0@lo:502: Request processed in 410us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850922.028383:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788850922.031145:0:8072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8072:1875746019625728:0@lo:502: 00000100:00100000:3.0:1788850922.038515:0:8072:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8072:1875746019625856:0@lo:502: 00000100:00100000:3.0:1788850922.038607:0:8072:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850922.038654:0:8072:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b82a8a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788850922.038707:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625856 00000100:00100000:0.0:1788850922.038715:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625856 00000100:00100000:0.0:1788850922.038757:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788850922.038765:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+14:8072:x1875746019625856:12345-0@lo:502: 00000100:00100000:0.0:1788850922.039036:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+14:8072:x1875746019625856:12345-0@lo:502: Request processed in 271us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850922.039043:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788850922.039297:0:8072:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8072:1875746019625856:0@lo:502: 00000040:00080000:3.0:1788850922.039322:0:8072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788850922.039775:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788850922.039821:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788850922.039831:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6c00/0x7ad3e1a879576aa0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576aa7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850922.039843:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6c00/0x7ad3e1a879576aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576aa7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850922.039853:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788850922.039855:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788850922.039858:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788850922.039887:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850922.039896:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850922.039905:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576aae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850922.039930:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019625984:0@lo:101: 00000100:00100000:1.0:1788850922.039968:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850922.039994:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b957929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.040152:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019625984 00000100:00100000:3.0:1788850922.040176:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019625984 00000100:00100000:3.0:1788850922.040213:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788850922.040231:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019625984:12345-0@lo:101: 00010000:00010000:3.0:1788850922.040242:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850922.040409:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a5800/0x7ad3e1a879576ab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576aae expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.040432:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a5800/0x7ad3e1a879576ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576aae expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.040442:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a5800/0x7ad3e1a879576ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576aae expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.040450:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a5800, rc 0) 00000100:00100000:3.0:1788850922.040484:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019625984:12345-0@lo:101: Request processed in 264us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850922.040490:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788850922.040636:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019625984:0@lo:101: 00010000:00010000:1.0:1788850922.040649:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576aae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576ab5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850922.040658:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576aae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576ab5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850922.040714:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019626112:0@lo:501: 00000100:00100000:1.0:1788850922.040744:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850922.040773:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b957929c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850922.040865:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019626112 00000100:00100000:0.0:1788850922.040869:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019626112 00000100:00100000:0.0:1788850922.040894:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788850922.040901:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019626112:12345-0@lo:501: 00000100:00100000:0.0:1788850922.041145:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019626112:12345-0@lo:501: Request processed in 244us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850922.041164:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788850922.041482:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019626112:0@lo:501: 00000100:00100000:1.0:1788850922.041512:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019626240:0@lo:503: 00000100:00100000:1.0:1788850922.041550:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850922.041581:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b957929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.041618:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019626240 00000100:00100000:3.0:1788850922.041622:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019626240 00000100:00100000:3.0:1788850922.041655:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788850922.041661:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019626240:12345-0@lo:503: 00000100:00100000:3.0:1788850922.042053:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019626240:12345-0@lo:503: Request processed in 391us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850922.042060:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788850922.043142:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019626240:0@lo:503: 00000100:00100000:1.0:1788850922.043844:0:8073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8073:1875746019626368:0@lo:502: 00000100:00100000:1.0:1788850922.044239:0:8073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850922.044381:0:8073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b95792b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.053471:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019626368 00000100:00100000:3.0:1788850922.053490:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019626368 00000100:00100000:3.0:1788850922.057592:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788850922.057624:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+15:8073:x1875746019626368:12345-0@lo:502: 00000100:00100000:3.0:1788850922.058034:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+15:8073:x1875746019626368:12345-0@lo:502: Request processed in 426us (14121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850922.058049:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788850922.058192:0:8073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8073:1875746019626368:0@lo:502: 00000020:01000000:1.0:1788850922.058242:0:8073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850922.058262:0:8073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850922.058265:0:8073:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788850922.058270:0:8073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788850922.058273:0:8073:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788850922.058306:0:8073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8073:1875746019626496:0@lo:502: 00000100:00100000:1.0:1788850922.058353:0:8073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850922.063930:0:8073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98574180 going to sleep for 11 seconds 00000100:00100000:0.0:1788850922.067278:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019626496 00000100:00100000:0.0:1788850922.067290:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019626496 00000100:00100000:0.0:1788850922.067352:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788850922.067365:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+15:8073:x1875746019626496:12345-0@lo:502: 00000100:00100000:0.0:1788850922.068017:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+15:8073:x1875746019626496:12345-0@lo:502: Request processed in 653us (9662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850922.068028:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788850922.069069:0:8073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8073:1875746019626496:0@lo:502: 00000020:01000000:1.0:1788850922.069110:0:8073:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850922.069118:0:8073:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850922.069120:0:8073:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788850922.069131:0:8073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1788850922.069758:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788850922.069807:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788850922.069819:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576aae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576ab5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850922.069832:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576ab5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850922.069844:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788850922.069846:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a9ba0462000 from 30 10000000:01000000:0.0:1788850922.069850:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788850922.069883:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879576abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850922.069892:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879576abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850922.069901:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879576abc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850922.069935:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019626624:0@lo:101: 00000100:00100000:0.0:1788850922.069996:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850922.070033:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019626624 00000100:00100000:0.0:1788850922.070045:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019626624 00000100:00100000:0.0:1788850922.070086:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788850922.070097:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019626624:12345-0@lo:101: 00010000:00010000:0.0:1788850922.070110:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850922.070124:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af7e00/0x7ad3e1a879576ac3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576abc expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850922.070148:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af7e00/0x7ad3e1a879576ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576abc expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850922.070528:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af7e00/0x7ad3e1a879576ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576abc expref: 16 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850922.070539:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7e00, rc 0) 00000100:00100000:0.0:1788850922.070576:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019626624:12345-0@lo:101: Request processed in 480us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850922.070583:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788850922.070633:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b906a7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850922.070652:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019626624:0@lo:101: 00010000:00010000:0.0:1788850922.070768:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879576abc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576ac3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850922.070778:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879576abc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576ac3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850922.070853:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019626752:0@lo:501: 00000100:00100000:0.0:1788850922.070881:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850922.070903:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019626752 00000100:00100000:0.0:1788850922.070907:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019626752 00000100:00100000:0.0:1788850922.071345:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788850922.071352:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019626752:12345-0@lo:501: 00000100:00100000:0.0:1788850922.071606:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019626752:12345-0@lo:501: Request processed in 254us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850922.071613:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788850922.071653:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b906a7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850922.073773:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019626752:0@lo:501: 00000100:00100000:1.0:1788850922.080933:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019626880:0@lo:503: 00000100:00100000:1.0:1788850922.081038:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850922.081087:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98574180 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.082963:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019626880 00000100:00100000:3.0:1788850922.082978:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019626880 00000100:00100000:3.0:1788850922.083051:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788850922.083063:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019626880:12345-0@lo:503: 00000100:00100000:3.0:1788850922.083510:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019626880:12345-0@lo:503: Request processed in 449us (2472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850922.083519:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788850922.084481:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019626880:0@lo:503: 00000100:00100000:1.0:1788850922.084773:0:8075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8075:1875746019627008:0@lo:502: 00000100:00100000:1.0:1788850922.084848:0:8075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850922.084882:0:8075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b985740c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.086308:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627008 00000100:00100000:3.0:1788850922.086319:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627008 00000100:00100000:3.0:1788850922.086375:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788850922.086385:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+16:8075:x1875746019627008:12345-0@lo:502: 00000100:00100000:3.0:1788850922.086657:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+16:8075:x1875746019627008:12345-0@lo:502: Request processed in 273us (1808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850922.086677:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788850922.088716:0:8075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8075:1875746019627008:0@lo:502: 00000100:00100000:0.0:1788850922.088838:0:8075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99172d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8075:1875746019627136:0@lo:502: 00000100:00100000:0.0:1788850922.088920:0:8075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850922.088967:0:8075:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b985740c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.089133:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627136 00000100:00100000:3.0:1788850922.089140:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627136 00000100:00100000:3.0:1788850922.089192:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788850922.089203:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+16:8075:x1875746019627136:12345-0@lo:502: 00000100:00100000:3.0:1788850922.089485:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+16:8075:x1875746019627136:12345-0@lo:502: Request processed in 284us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850922.089493:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788850922.089883:0:8075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99172d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8075:1875746019627136:0@lo:502: 00000040:00080000:0.0:1788850922.089922:0:8075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788850922.090595:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788850922.090623:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788850922.090634:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879576abc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576ac3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.090661:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879576abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576ac3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850922.090671:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788850922.090673:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a9ba0462000 from 5 10000000:01000000:3.0:1788850922.090676:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788850922.090708:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.090716:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.090725:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850922.090743:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019627264:0@lo:101: 00000100:00100000:3.0:1788850922.090815:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850922.090849:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb62eb480 going to sleep for 11 seconds 00000100:00100000:0.0:1788850922.091389:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627264 00000100:00100000:0.0:1788850922.091398:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627264 00000100:00100000:0.0:1788850922.091441:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788850922.091450:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019627264:12345-0@lo:101: 00010000:00010000:0.0:1788850922.091461:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850922.091475:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af7200/0x7ad3e1a879576ad1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576aca expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850922.091497:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af7200/0x7ad3e1a879576ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576aca expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850922.091507:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af7200/0x7ad3e1a879576ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576aca expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850922.091669:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7200, rc 0) 00000100:00100000:0.0:1788850922.091711:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019627264:12345-0@lo:101: Request processed in 262us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850922.091717:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788850922.092387:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019627264:0@lo:101: 00010000:00010000:3.0:1788850922.092405:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576ad1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.092417:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576ad1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850922.092476:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019627392:0@lo:256: 00000100:00100000:3.0:1788850922.092517:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850922.092604:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627392 00000100:00100000:0.0:1788850922.092610:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627392 00000100:00100000:0.0:1788850922.092649:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788850922.092657:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019627392:12345-0@lo:256: 20000000:01000000:0.0:1788850922.092672:0:5856:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788850922.092689:0:5856:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788850922.092692:0:5856:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788850922.092765:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019627392:12345-0@lo:256: Request processed in 108us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850922.092772:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788850922.093285:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb62eb480 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.093596:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019627392:0@lo:256: 10000000:01000000:3.0:1788850922.093733:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788850922.093744:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576ad1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.093756:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576ad1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850922.093767:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788850922.093770:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788850922.093773:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788850922.093835:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4a00/0x7ad3e1a879576ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.093844:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4a00/0x7ad3e1a879576ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.093853:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4a00/0x7ad3e1a879576ad8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850922.093868:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019627520:0@lo:101: 00000100:00100000:3.0:1788850922.094671:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850922.094709:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb62eb480 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.094736:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627520 00000100:00100000:3.0:1788850922.094743:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627520 00000100:00100000:3.0:1788850922.094809:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788850922.094818:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019627520:12345-0@lo:101: 00010000:00010000:3.0:1788850922.094830:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850922.094854:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576adf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576ad8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.094879:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576ad8 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.094892:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576ad8 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.095107:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a5400, rc 0) 00000100:00100000:3.0:1788850922.095173:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019627520:12345-0@lo:101: Request processed in 355us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850922.095179:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788850922.095633:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019627520:0@lo:101: 00010000:00010000:0.0:1788850922.095652:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4a00/0x7ad3e1a879576ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576adf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850922.095676:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4a00/0x7ad3e1a879576ad8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576adf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850922.095743:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99172d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019627648:0@lo:501: 00000100:00100000:0.0:1788850922.095778:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850922.095900:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b91a05b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.096082:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627648 00000100:00100000:3.0:1788850922.096088:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627648 00000100:00100000:3.0:1788850922.096122:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788850922.096131:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019627648:12345-0@lo:501: 00000100:00100000:3.0:1788850922.097143:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019627648:12345-0@lo:501: Request processed in 1011us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850922.097154:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788850922.097805:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99172d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019627648:0@lo:501: 00000100:00100000:0.0:1788850922.097853:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99172d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019627776:0@lo:503: 00000100:00100000:0.0:1788850922.098336:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850922.098373:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b91a05b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.099068:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627776 00000100:00100000:3.0:1788850922.099078:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627776 00000100:00100000:3.0:1788850922.099136:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788850922.099145:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019627776:12345-0@lo:503: 00000100:00100000:3.0:1788850922.099549:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019627776:12345-0@lo:503: Request processed in 403us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850922.099556:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788850922.099770:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99172d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019627776:0@lo:503: 00000100:00100000:0.0:1788850922.102644:0:8076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8076:1875746019627904:0@lo:502: 00000100:00100000:0.0:1788850922.102753:0:8076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850922.102823:0:8076:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b91a05f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.103043:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019627904 00000100:00100000:3.0:1788850922.103052:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019627904 00000100:00100000:3.0:1788850922.103121:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788850922.103132:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:8076:x1875746019627904:12345-0@lo:502: 00000100:00100000:3.0:1788850922.106466:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:8076:x1875746019627904:12345-0@lo:502: Request processed in 3325us (3701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850922.106482:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788850922.114589:0:8076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8076:1875746019627904:0@lo:502: 00000020:01000000:0.0:1788850922.114764:0:8076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788850922.114774:0:8076:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788850922.114818:0:8076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850922.114821:0:8076:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788850922.114827:0:8076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788850922.114830:0:8076:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:01000000:0.0:1788850922.114855:0:8076:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788850922.114858:0:8076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788850922.114886:0:8076:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a9bb3f3cd40) 00000020:00000080:0.0:1788850922.114927:0:8076:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788850922.114939:0:8076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788850922.115040:0:8076:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788850922.115046:0:8076:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788850922.115055:0:8076:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ad3e1a879576aed 00010000:00080000:0.0:1788850922.115091:0:8076:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a9b87c35800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.106@tcp at head 00010000:00010000:0.0:1788850922.115333:0:8076:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788850922.115680:0:8076:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788850922.115696:0:8076:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788850922.116271:0:8076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788850922.116488:0:8076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788850922.116538:0:8076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788850922.116602:0:8076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788850922.127547:0:8077:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788850922.127555:0:8077:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788850922.136527:0:8076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788850922.136543:0:8076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788850922.136589:0:8076:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788850922.136619:0:8076:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ad3e1a879576af4 00000100:00080000:0.0:1788850922.136630:0:8076:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788850922.136643:0:8076:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a9b87c35800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1788850922.136698:0:8076:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9b99173b80 x1875746019628032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788850922.136731:0:8076:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788850922.136854:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019628160:0@lo:400: 00000100:00100000:0.0:1788850922.137297:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850922.137338:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788850922.137346:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019628544:0@lo:400: 00000100:00100000:0.0:1788850922.137372:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850922.137403:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019628288:0@lo:400: 00000100:00100000:0.0:1788850922.137427:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850922.137453:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788850922.137458:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019628416:0@lo:400: 00000100:00100000:0.0:1788850922.137484:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850922.137521:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628160 00000100:00100000:0.0:1788850922.137528:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628160 00000100:00100000:0.0:1788850922.137564:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628544 00000100:00100000:0.0:1788850922.137567:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628544 00000100:00100000:0.0:1788850922.137592:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628288 00000100:00100000:0.0:1788850922.137595:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628288 00000100:00100000:0.0:1788850922.137611:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788850922.137619:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019628160:12345-0@lo:400: 00000100:00100000:1.0:1788850922.137759:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019628032:0@lo:8: 00000100:00100000:1.0:1788850922.137815:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850922.138032:0:5863:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788850922.138042:0:5863:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788850922.138060:0:5861:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788850922.138068:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788850922.138077:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019628544:12345-0@lo:400: 00000100:00100000:1.0:1788850922.138117:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019628544:12345-0@lo:400: Request processed in 40us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850922.138123:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788850922.138139:0:5861:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788850922.138145:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788850922.138151:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019628288:12345-0@lo:400: 00000100:00100000:1.0:1788850922.138181:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019628288:12345-0@lo:400: Request processed in 30us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850922.138198:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000020:01000000:1.0:1788850922.138274:0:8076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850922.138280:0:8076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850922.138283:0:8076:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788850922.138286:0:8076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850922.138290:0:8076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850922.138292:0:8076:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788850922.138295:0:8076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788850922.138296:0:8076:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788850922.138324:0:8076:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8076:1875746019628672:0@lo:502: 00000100:00100000:1.0:1788850922.138369:0:8076:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850922.138390:0:8076:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf449c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850922.138473:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019628160:12345-0@lo:400: Request processed in 853us (1177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850922.138480:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788850922.138512:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628416 00000100:00100000:0.0:1788850922.138518:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628416 00000100:00100000:0.0:1788850922.138547:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628032 00000100:00100000:0.0:1788850922.138551:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628032 00000100:00100000:0.0:1788850922.138562:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788850922.138568:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019628416:12345-0@lo:400: 00000100:00100000:0.0:1788850922.138602:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019628416:12345-0@lo:400: Request processed in 34us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850922.138608:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788850922.138620:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788850922.138623:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875746019628032:12345-0@lo:8: 00010000:00080000:0.0:1788850922.138648:0:6706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 255 last 0 00000020:00000080:0.0:1788850922.140211:0:6706:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ad3e1a879576afb 00002000:00100000:0.0:1788850922.140244:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a9b87c31000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788850922.140250:0:6706:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1788850922.140254:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788850922.140391:0:6706:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788850922.140552:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788850922.140581:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c37800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788850922.142371:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628672 00000100:00100000:1.0:1788850922.142389:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628672 00000100:00100000:1.0:1788850922.142455:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788850922.142466:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:8076:x1875746019628672:12345-0@lo:502: 00000100:00100000:1.0:1788850922.147355:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:8076:x1875746019628672:12345-0@lo:502: Request processed in 4883us (8976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850922.147371:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1788850922.147549:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b99173b80 x1875746019628032/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788850932 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850922.147563:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788850922.147576:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788850922.147587:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788850922.147593:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788850922.147597:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c35800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788850922.147618:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788850922.147625:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019628032:0@lo:8: 00000100:00100000:2.0:1788850922.147819:0:8076:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8076:1875746019628672:0@lo:502: 00000020:01000000:2.0:1788850922.147852:0:8076:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850922.147859:0:8076:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850922.147861:0:8076:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788850922.147865:0:8076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788850922.148164:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788850922.148183:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788850922.148193:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4a00/0x7ad3e1a879576ad8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576adf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850922.148205:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4a00/0x7ad3e1a879576ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576adf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850922.148215:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788850922.148218:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a9b90470000 from 1 10000000:01000000:1.0:1788850922.148237:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788850922.148273:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a879576b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850922.148282:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a879576b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850922.148292:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a879576b02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850922.148313:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019628800:0@lo:101: 00000100:00100000:1.0:1788850922.148365:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850922.148410:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b957929c0 going to sleep for 11 seconds 00000004:00080000:1.0:1788850922.148426:0:8077:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788850922.148581:0:8077:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 255089798695ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788850922.148815:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628800 00000100:00100000:3.0:1788850922.148824:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628800 00000100:00100000:3.0:1788850922.148864:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788850922.148874:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019628800:12345-0@lo:101: 00010000:00010000:3.0:1788850922.148887:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850922.148901:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576b09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576b02 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.148940:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576b02 expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.148952:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576b02 expref: 19 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.148972:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a5c00, rc 0) 00000100:00100000:3.0:1788850922.149016:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019628800:12345-0@lo:101: Request processed in 144us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850922.149022:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788850922.149061:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d74a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019628800:0@lo:101: 00010000:00010000:3.0:1788850922.149075:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a879576b02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.149085:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a879576b02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576b09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850922.149130:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019628928:0@lo:501: 00000100:00100000:3.0:1788850922.149157:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850922.149172:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b957929c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.149183:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019628928 00000100:00100000:3.0:1788850922.149186:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019628928 00000100:00100000:3.0:1788850922.149211:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788850922.149217:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019628928:12345-0@lo:501: 00000100:00100000:3.0:1788850922.149440:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019628928:12345-0@lo:501: Request processed in 223us (281us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788850922.149448:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788850922.149477:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019628928:0@lo:501: 10000000:01000000:3.0:1788850922.149499:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788850922.149505:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a879576b02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850922.149523:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a879576b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850922.150368:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875746019628032:12345-0@lo:8: Request processed in 11737us (12546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850922.150379:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788850922.152446:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788850922.152456:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788850922.159409:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b99170a80 x1875746019628416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850922.159431:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019628416:0@lo:400: 00010000:00080000:0.0:1788850922.159458:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b99172300 x1875746019628288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850922.159468:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019628288:0@lo:400: 00010000:00080000:0.0:1788850922.159512:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b99172680 x1875746019628544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850922.159522:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019628544:0@lo:400: 00010000:00080000:0.0:1788850922.159533:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b99172a00 x1875746019628160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850938 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850922.159541:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99172a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019628160:0@lo:400: 00000004:00080000:2.0:1788850922.195263:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788850922.195358:0:8078:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788850922.195388:0:8078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8078:1875746019629184:0@lo:7: 00000100:00100000:1.0:1788850922.195460:0:8078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850922.195511:0:8078:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9baccedd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788850922.195562:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629184 00000100:00100000:2.0:1788850922.195570:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629184 00000100:00100000:2.0:1788850922.195635:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788850922.195645:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8078:x1875746019629184:12345-0@lo:7: 00000100:00080000:1.0:1788850922.196066:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788850922.198585:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019629056:0@lo:13: 00000100:00100000:0.0:1788850922.198722:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850922.198980:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629056 00000100:00100000:0.0:1788850922.198989:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629056 00000100:00100000:0.0:1788850922.199033:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788850922.199042:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875746019629056:12345-0@lo:13: 00002000:00000024:0.0:1788850922.199070:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788850922.199120:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875746019629056:12345-0@lo:13: Request processed in 79us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850922.199126:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788850922.199472:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc1d74700 x1875746019629056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850938 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850922.199493:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019629056:0@lo:13: 00002000:00080000:3.0:1788850922.201818:0:6704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788850922.201825:0:6704:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788850922.201993:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8078:x1875746019629184:12345-0@lo:7: Request processed in 6347us (6529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850922.202005:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788850922.202053:0:8078:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc1d77800 x1875746019629184/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788850938 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850922.202068:0:8078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8078:1875746019629184:0@lo:7: 00000004:00080000:3.0:1788850922.202083:0:8078:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788850922.202123:0:8078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8078:1875746019629312:0@lo:5: 00000100:00100000:3.0:1788850922.202156:0:8078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850922.202237:0:8078:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb39ac0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.202256:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629312 00000100:00100000:3.0:1788850922.202262:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629312 00000100:00100000:3.0:1788850922.202305:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788850922.202314:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8078:x1875746019629312:12345-0@lo:5: 00002000:00080000:3.0:1788850922.202337:0:6704:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788850922.202341:0:6704:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788850922.202603:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8078:x1875746019629312:12345-0@lo:5: Request processed in 290us (445us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788850922.202610:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788850922.206132:0:8078:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bb3664e00 x1875746019629312/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788850938 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850922.206154:0:8078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8078:1875746019629312:0@lo:5: 00000004:00080000:1.0:1788850922.206174:0:8078:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788850922.206230:0:8078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8078:1875746019629440:0@lo:700: 00000100:00100000:1.0:1788850922.206288:0:8078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850922.206326:0:8078:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bacced480 going to sleep for 11 seconds 00000100:00100000:3.0:1788850922.206415:0:6714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629440 00000100:00100000:3.0:1788850922.206423:0:6714:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629440 00000100:00100000:3.0:1788850922.206484:0:6714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788850922.206492:0:6714:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8078:x1875746019629440:12345-0@lo:700: 00000100:00100000:3.0:1788850922.206527:0:6714:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3666300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6714:1875746019629568:0@lo:700: 00000100:00100000:3.0:1788850922.206557:0:6714:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850922.206587:0:6714:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb39ac900 going to sleep for 11 seconds 00000100:00100000:2.0:1788850922.206846:0:5868:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629568 00000100:00100000:2.0:1788850922.206851:0:5868:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629568 00000100:00100000:2.0:1788850922.207033:0:5868:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788850922.207041:0:5868:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6714:x1875746019629568:12345-0@lo:700: 40000000:02000000:2.0:1788850922.243395:0:5868:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788850922.249166:0:5868:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6714:x1875746019629568:12345-0@lo:700: Request processed in 42115us (42597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850922.249183:0:5868:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788850922.249291:0:6714:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bb3666300 x1875746019629568/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788850938 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850922.249309:0:6714:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3666300 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6714:1875746019629568:0@lo:700: 40000000:02000000:3.0:1788850922.249326:0:6714:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:0.0:1788850922.258075:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850922.387837:0:6714:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8078:x1875746019629440:12345-0@lo:700: Request processed in 181335us (181538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850922.387858:0:6714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:0.0:1788850922.389532:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788850922.389573:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:1.0:1788850922.390573:0:8078:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc1d76300 x1875746019629440/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788850938 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850922.390593:0:8078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8078:1875746019629440:0@lo:700: 00000004:02000040:1.0:1788850922.456131:0:8078:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788850922.462044:0:8078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8078:1875746019629696:0@lo:5: 00000100:00100000:1.0:1788850922.462119:0:8078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850922.462180:0:8078:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bacced540 going to sleep for 11 seconds 00000100:00100000:2.0:1788850922.464831:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629696 00000100:00100000:2.0:1788850922.464844:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629696 00000100:00100000:2.0:1788850922.464915:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788850922.464928:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8078:x1875746019629696:12345-0@lo:5: 00002000:00080000:2.0:1788850922.475258:0:6707:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788850922.475280:0:6707:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788850922.482519:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8078:x1875746019629696:12345-0@lo:5: Request processed in 17476us (20282us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788850922.482533:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788850922.482764:0:8078:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc1d76300 x1875746019629696/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788850938 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850922.482889:0:8078:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788850922.482910:0:8078:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a9bc1d76300 x1875746019629696/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788850938 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850922.482922:0:8078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8078:1875746019629696:0@lo:5: 00000004:00080000:1.0:1788850922.482937:0:8078:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788850923.026400:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019629824:0@lo:13: 00000100:00100000:0.0:1788850923.026472:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850923.026616:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629824 00000100:00100000:1.0:1788850923.026625:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629824 00000100:00100000:1.0:1788850923.026680:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788850923.026690:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019629824:12345-0@lo:13: 00002000:00000024:1.0:1788850923.026730:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850923.026936:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019629824:12345-0@lo:13: Request processed in 247us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850923.026944:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788850923.027023:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc1d77800 x1875746019629824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850939 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850923.027043:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019629824:0@lo:13: 00010000:00010000:2.0:1788850923.282869:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850924.306439:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850925.332822:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788850926.126614:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1788850926.354828:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850926.628605:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850926.628936:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000732288 00000100:00100000:3.0:1788850926.628949:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000732288 00000100:00100000:3.0:1788850926.629833:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 112 00000100:00100000:3.0:1788850926.629843:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1875746000732288:12345-192.168.204.6@tcp:250: 00010000:00080000:3.0:1788850926.629872:0:5855:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6835cbef-1345-4ac2-988d-7ad135109255@192.168.204.6@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1788850926.629902:0:5855:0:(genops.c:1384:class_connect()) connect: client 6835cbef-1345-4ac2-988d-7ad135109255, cookie 0x7ad3e1a879576b10 00000100:00080000:2.0:1788850926.630492:0:5855:0:(import.c:65:import_set_state_nolock()) ffff8a9bb6ff6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788850926.630608:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+5:2350:x1875746000732288:12345-192.168.204.6@tcp:250: Request processed in 764us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850926.630618:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 112 00000100:00100000:3.0:1788850926.639567:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850926.639651:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000732416 00000100:00100000:1.0:1788850926.639661:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000732416 00000100:00100000:1.0:1788850926.639721:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 113 00000100:00100000:1.0:1788850926.639732:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+5:5592:x1875746000732416:12345-192.168.204.6@tcp:101: 00010000:00010000:1.0:1788850926.639756:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850926.639776:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b8168fa00/0x7ad3e1a879576b17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfe979 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850926.640101:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b8168fa00/0x7ad3e1a879576b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe979 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850926.640113:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b8168fa00/0x7ad3e1a879576b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe979 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850926.640121:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168fa00, rc 0) 00000100:00100000:1.0:1788850926.640181:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+6:5592:x1875746000732416:12345-192.168.204.6@tcp:101: Request processed in 452us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850926.640188:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 113 00000100:00100000:1.0:1788850926.643279:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850926.643349:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000732544 00000100:00100000:3.0:1788850926.643360:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000732544 00000100:00100000:3.0:1788850926.644149:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 114 00000100:00100000:3.0:1788850926.644163:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+6:5592:x1875746000732544:12345-192.168.204.6@tcp:501: 00000100:00100000:3.0:1788850926.644413:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+6:5592:x1875746000732544:12345-192.168.204.6@tcp:501: Request processed in 252us (1143us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788850926.644421:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 114 00000100:00100000:3.0:1788850926.652360:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850926.652441:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000732672 00000100:00100000:0.0:1788850926.652455:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000732672 00000100:00100000:0.0:1788850926.652526:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 115 00000100:00100000:0.0:1788850926.652537:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+6:5592:x1875746000732672:12345-192.168.204.6@tcp:101: 00010000:00010000:0.0:1788850926.652566:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850926.652596:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879576b1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfe980 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850926.652627:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879576b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe980 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850926.652946:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879576b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe980 expref: 7 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850926.653070:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6200, rc 0) 00000100:00100000:0.0:1788850926.653150:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+7:5592:x1875746000732672:12345-192.168.204.6@tcp:101: Request processed in 614us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850926.653157:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 115 00000100:00100000:0.0:1788850926.655400:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850926.656433:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000732800 00000100:00100000:3.0:1788850926.656446:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000732800 00000100:00100000:3.0:1788850926.656512:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 116 00000100:00100000:3.0:1788850926.656524:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+7:5592:x1875746000732800:12345-192.168.204.6@tcp:501: 00000100:00100000:3.0:1788850926.657328:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+8:5592:x1875746000732800:12345-192.168.204.6@tcp:501: Request processed in 801us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850926.657340:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 116 00000100:00100000:1.0:1788850926.660900:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850926.661201:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000732928 00000100:00100000:3.0:1788850926.661213:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000732928 00000100:00100000:3.0:1788850926.661272:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 117 00000100:00100000:3.0:1788850926.661283:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+8:5592:x1875746000732928:12345-192.168.204.6@tcp:503: 00000100:00100000:3.0:1788850926.661609:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+8:5592:x1875746000732928:12345-192.168.204.6@tcp:503: Request processed in 327us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850926.661617:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 117 00000100:00100000:1.0:1788850926.672605:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850926.672678:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733056 00000100:00100000:3.0:1788850926.672691:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733056 00000100:00100000:3.0:1788850926.672762:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 118 00000100:00100000:3.0:1788850926.672775:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+8:5610:x1875746000733056:12345-192.168.204.6@tcp:502: 00000100:00100000:3.0:1788850926.673402:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+8:5610:x1875746000733056:12345-192.168.204.6@tcp:502: Request processed in 627us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850926.673410:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 118 00000100:00100000:1.0:1788850926.715420:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850926.715656:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733184 00000100:00100000:0.0:1788850926.715667:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733184 00000100:00100000:0.0:1788850926.715727:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 119 00000100:00100000:0.0:1788850926.715738:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+8:5610:x1875746000733184:12345-192.168.204.6@tcp:502: 00000100:00100000:0.0:1788850926.716189:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+8:5610:x1875746000733184:12345-192.168.204.6@tcp:502: Request processed in 451us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850926.716204:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 119 00000100:00100000:1.0:1788850926.719645:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850926.720268:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733312 00000100:00100000:3.0:1788850926.720280:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733312 00000100:00100000:3.0:1788850926.720477:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 120 00000100:00100000:3.0:1788850926.720487:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+8:5592:x1875746000733312:12345-192.168.204.6@tcp:101: 00010000:00010000:3.0:1788850926.720505:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850926.720522:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a5a00/0x7ad3e1a879576b25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfe9aa expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850926.720548:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a5a00/0x7ad3e1a879576b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9aa expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850926.720559:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a5a00/0x7ad3e1a879576b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9aa expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850926.720568:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a5a00, rc 0) 00000100:00100000:3.0:1788850926.720635:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+9:5592:x1875746000733312:12345-192.168.204.6@tcp:101: Request processed in 149us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850926.720642:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 120 00000100:00100000:1.0:1788850926.729588:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850926.730825:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733440 00000100:00100000:3.0:1788850926.730936:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733440 00000100:00100000:3.0:1788850926.731061:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 121 00000100:00100000:3.0:1788850926.731073:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+9:5592:x1875746000733440:12345-192.168.204.6@tcp:256: 20000000:01000000:3.0:1788850926.731101:0:5853:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788850926.731121:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788850926.731142:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788850926.731146:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788850926.731149:0:5853:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788850926.740194:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+9:5592:x1875746000733440:12345-192.168.204.6@tcp:256: Request processed in 9110us (10602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850926.740212:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 121 00000100:00100000:3.0:1788850926.745058:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850926.745157:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733568 00000100:00100000:0.0:1788850926.745168:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733568 00000100:00100000:0.0:1788850926.745224:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 122 00000100:00100000:0.0:1788850926.745234:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+9:5592:x1875746000733568:12345-192.168.204.6@tcp:101: 00010000:00010000:0.0:1788850926.745250:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850926.745271:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af6600/0x7ad3e1a879576b2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfe9b1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850926.745300:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af6600/0x7ad3e1a879576b2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9b1 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850926.745312:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af6600/0x7ad3e1a879576b2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9b1 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850926.745322:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6600, rc 0) 00000100:00100000:0.0:1788850926.745394:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+10:5592:x1875746000733568:12345-192.168.204.6@tcp:101: Request processed in 161us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850926.745401:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 122 00000100:00100000:2.0:1788850926.749489:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850926.749577:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733696 00000100:00100000:1.0:1788850926.749595:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733696 00000100:00100000:1.0:1788850926.749652:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 123 00000100:00100000:1.0:1788850926.749661:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:5592:x1875746000733696:12345-192.168.204.6@tcp:501: 00000100:00100000:1.0:1788850926.750380:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:5592:x1875746000733696:12345-192.168.204.6@tcp:501: Request processed in 718us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850926.750395:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 123 00000100:00100000:0.0:1788850926.756432:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850926.756477:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733824 00000100:00100000:0.0:1788850926.756489:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733824 00000100:00100000:0.0:1788850926.756547:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 124 00000100:00100000:0.0:1788850926.756557:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:5592:x1875746000733824:12345-192.168.204.6@tcp:503: 00000100:00100000:0.0:1788850926.757222:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:5592:x1875746000733824:12345-192.168.204.6@tcp:503: Request processed in 662us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850926.757231:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 124 00000100:00100000:0.0:1788850926.761582:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850926.762050:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000733952 00000100:00100000:3.0:1788850926.762061:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000733952 00000100:00100000:3.0:1788850926.762119:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 125 00000100:00100000:3.0:1788850926.762140:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+10:5614:x1875746000733952:12345-192.168.204.6@tcp:502: 00000100:00100000:3.0:1788850926.762443:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+10:5614:x1875746000733952:12345-192.168.204.6@tcp:502: Request processed in 312us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850926.762451:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 125 00000100:00100000:3.0:1788850926.772320:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850926.772393:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734080 00000100:00100000:0.0:1788850926.772405:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734080 00000100:00100000:0.0:1788850926.773233:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 126 00000100:00100000:0.0:1788850926.773251:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:5614:x1875746000734080:12345-192.168.204.6@tcp:502: 00000100:00100000:0.0:1788850926.773524:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:5614:x1875746000734080:12345-192.168.204.6@tcp:502: Request processed in 277us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850926.773533:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 126 00000100:00100000:1.0:1788850926.785334:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850926.785427:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734208 00000100:00100000:3.0:1788850926.785438:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734208 00000100:00100000:3.0:1788850926.785477:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:3.0:1788850926.785485:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1875746000734208:12345-192.168.204.6@tcp:38: 00010000:00080000:3.0:1788850926.785515:0:5861:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1788850926.785568:0:5861:0:(genops.c:1384:class_connect()) connect: client 3c328062-9d4c-41e6-ae57-f4af3bf37898, cookie 0x7ad3e1a879576b33 00000004:00100000:3.0:1788850926.785609:0:5861:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788850926.785616:0:5861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788850926.841458:0:5861:0:(import.c:65:import_set_state_nolock()) ffff8a9bb44b2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788850926.841555:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2350:x1875746000734208:12345-192.168.204.6@tcp:38: Request processed in 56068us (56230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850926.841568:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 4 00010000:00010000:3.0:1788850927.380389:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850927.633997:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019630208:0@lo:400: 00000100:00100000:0.0:1788850927.634013:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019630336:0@lo:400: 00000100:00100000:3.0:1788850927.634151:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019630080:0@lo:13: 00000100:00100000:1.0:1788850927.638953:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850927.639098:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019630720:0@lo:400: 00000100:00100000:1.0:1788850927.639157:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850927.639230:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630720 00000100:00100000:1.0:1788850927.639238:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630720 00000100:00100000:1.0:1788850927.639291:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788850927.640539:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019630720:12345-0@lo:400: 00000100:00100000:2.0:1788850927.640544:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630208 00000100:00100000:2.0:1788850927.640551:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630208 00000100:00100000:2.0:1788850927.640597:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788850927.640604:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019630208:12345-0@lo:400: 00000100:00100000:1.0:1788850927.640638:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4133800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019630720:12345-0@lo:400: Request processed in 1339us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850927.640648:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4131c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019630208:12345-0@lo:400: Request processed in 46us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850927.640648:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788850927.640654:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788850927.640676:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019630464:0@lo:400: 00000100:00080000:2.0:1788850927.640702:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788850927.641107:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788850927.641188:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc18c2a00 x1875746019630720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850927.641199:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788850927.641215:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019630720:0@lo:400: 00010000:00080000:1.0:1788850927.641229:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b99170a80 x1875746019630208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850927.641238:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019630208:0@lo:400: 00000100:00100000:2.0:1788850927.641614:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630464 00000100:00100000:2.0:1788850927.641630:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630464 00000100:00100000:2.0:1788850927.641674:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788850927.641682:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019630464:12345-0@lo:400: 00000100:00100000:2.0:1788850927.641738:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019630464:12345-0@lo:400: Request processed in 57us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850927.641743:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788850927.641989:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788850927.642016:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc18c3480 x1875746019630464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850927.642052:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019630464:0@lo:400: 00000100:00100000:0.0:1788850927.645646:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850927.645817:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630336 00000100:00100000:2.0:1788850927.645829:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630336 00000100:00100000:2.0:1788850927.645890:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788850927.645890:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788850927.645901:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019630336:12345-0@lo:400: 00000100:00100000:2.0:1788850927.645984:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019630336:12345-0@lo:400: Request processed in 86us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850927.645990:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788850927.646212:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b99173b80 x1875746019630336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850927.646228:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019630336:0@lo:400: 00000100:00100000:3.0:1788850927.648224:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850927.648638:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019629952:0@lo:400: 00000100:00100000:3.0:1788850927.648689:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850927.648849:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019630592:0@lo:400: 00000100:00100000:1.0:1788850927.648858:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019629952 00000100:00100000:1.0:1788850927.648867:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019629952 00000100:00100000:3.0:1788850927.648876:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850927.648921:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788850927.648931:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019629952:12345-0@lo:400: 00000100:00100000:1.0:1788850927.648996:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019629952:12345-0@lo:400: Request processed in 67us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850927.649003:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788850927.649018:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630080 00000100:00100000:0.0:1788850927.649023:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630080 00000100:00100000:0.0:1788850927.649072:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788850927.649079:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019630080:12345-0@lo:13: 00002000:00000024:0.0:1788850927.649125:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788850927.649162:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3666300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019630080:12345-0@lo:13: Request processed in 84us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850927.649169:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788850927.649431:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630592 00000100:00100000:2.0:1788850927.649436:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630592 00000100:00100000:2.0:1788850927.649495:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788850927.649502:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019630592:12345-0@lo:400: 00000100:00100000:2.0:1788850927.649541:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019630592:12345-0@lo:400: Request processed in 40us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850927.649557:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788850927.649638:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788850927.649895:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc1d77800 x1875746019630080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850943 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850927.649916:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019630080:0@lo:13: 00000100:00100000:3.0:1788850927.649927:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019629952:0@lo:400: 00010000:00080000:3.0:1788850927.649937:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc18c2d80 x1875746019630592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788850943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850927.649945:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019630592:0@lo:400: 00000100:00100000:1.0:1788850927.854665:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850927.854714:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850927.854847:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734464 00000100:00100000:3.0:1788850927.854861:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734464 00000100:00100000:3.0:1788850927.854943:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734336 00000100:00100000:3.0:1788850927.854946:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734336 00000100:00100000:3.0:1788850927.854966:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:3.0:1788850927.854978:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:5592:x1875746000734464:12345-192.168.204.6@tcp:41: 00000100:00100000:0.0:1788850927.855136:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:0.0:1788850927.855147:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:0:x1875746000734336:12345-192.168.204.6@tcp:41: 00000004:00000024:3.0:1788850927.855229:0:5861:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000004:00000024:0.0:1788850927.855359:0:8079:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788850927.855396:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4131880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:0:x1875746000734336:12345-192.168.204.6@tcp:41: Request processed in 251us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850927.855418:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:3.0:1788850927.855514:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4130e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:5592:x1875746000734464:12345-192.168.204.6@tcp:41: Request processed in 538us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850927.855521:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00080000:1.0:1788850927.855848:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788850927.868878:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850927.868971:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734592 00000100:00100000:0.0:1788850927.868980:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734592 00000100:00100000:0.0:1788850927.869043:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:0.0:1788850927.869054:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:5592:x1875746000734592:12345-192.168.204.6@tcp:40: 00000100:00100000:0.0:1788850927.869161:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:5592:x1875746000734592:12345-192.168.204.6@tcp:40: Request processed in 108us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850927.869168:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:1.0:1788850927.872720:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850927.872760:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850927.872918:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734976 00000100:00100000:0.0:1788850927.872928:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734976 00000100:00100000:0.0:1788850927.872981:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:0.0:1788850927.872992:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:5592:x1875746000734976:12345-192.168.204.6@tcp:33: 00000100:00100000:1.0:1788850927.875048:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850927.882856:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850927.882893:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000735104 00000100:00100000:1.0:1788850927.882904:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000735104 00000100:00100000:1.0:1788850927.882962:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 128 00000100:00100000:1.0:1788850927.882973:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:2352:x1875746000735104:12345-192.168.204.6@tcp:400: 00000100:00100000:1.0:1788850927.883044:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:2352:x1875746000735104:12345-192.168.204.6@tcp:400: Request processed in 73us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850927.883052:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 128 00000100:00100000:3.0:1788850927.892581:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734720 00000100:00100000:3.0:1788850927.892605:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734720 00000100:00100000:3.0:1788850927.892679:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000734848 00000100:00100000:3.0:1788850927.892683:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000734848 00000100:00100000:3.0:1788850927.892701:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:3.0:1788850927.892725:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875746000734720:12345-192.168.204.6@tcp:8: 00010000:00080000:3.0:1788850927.892759:0:6706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:3.0:1788850927.892808:0:6706:0:(genops.c:1384:class_connect()) connect: client 3c328062-9d4c-41e6-ae57-f4af3bf37898, cookie 0x7ad3e1a879576b3a 00002000:00100000:3.0:1788850927.892821:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3c328062-9d4c-41e6-ae57-f4af3bf37898/ffff8a9ba05c1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788850927.892848:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788850927.893210:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788850927.893247:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8a9ba05c7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788850927.893336:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4130000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2350:x1875746000734720:12345-192.168.204.6@tcp:8: Request processed in 611us (20573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850927.893344:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:3.0:1788850927.893367:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:3.0:1788850927.893372:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4133480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875746000734848:12345-192.168.204.6@tcp:8: 00010000:00080000:3.0:1788850927.893390:0:6706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp t0 exp 0000000000000000 cur 260 last 0 00000020:00000080:3.0:1788850927.893408:0:6706:0:(genops.c:1384:class_connect()) connect: client 3c328062-9d4c-41e6-ae57-f4af3bf37898, cookie 0x7ad3e1a879576b41 00002000:00100000:3.0:1788850927.893413:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3c328062-9d4c-41e6-ae57-f4af3bf37898/ffff8a9ba05c3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788850927.893420:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788850927.893682:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788850927.893699:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8a9b84e5f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788850927.893726:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4133480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2350:x1875746000734848:12345-192.168.204.6@tcp:8: Request processed in 352us (18687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850927.893732:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00000004:00080000:1.0:1788850927.912282:0:5864:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 39216us 00000004:00200000:1.0:1788850927.939947:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788850927.940136:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:5592:x1875746000734976:12345-192.168.204.6@tcp:33: Request processed in 67138us (67418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850927.940167:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:0.0:1788850928.146263:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019630848:0@lo:13: 00000100:00100000:0.0:1788850928.146342:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850928.146495:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630848 00000100:00100000:1.0:1788850928.146504:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630848 00000100:00100000:1.0:1788850928.146560:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788850928.146570:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019630848:12345-0@lo:13: 00002000:00000024:1.0:1788850928.146592:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850928.146648:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019630848:12345-0@lo:13: Request processed in 79us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850928.146655:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788850928.146738:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bb4132d80 x1875746019630848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850944 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850928.146757:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019630848:0@lo:13: 00000100:00100000:1.0:1788850928.211177:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850928.211343:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000735232 00000100:00100000:3.0:1788850928.211358:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000735232 00000100:00100000:3.0:1788850928.211498:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:3.0:1788850928.211511:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:5631:x1875746000735232:12345-192.168.204.6@tcp:101: 00010000:00010000:3.0:1788850928.211540:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850928.213360:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879576b48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfe9db expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850928.213459:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b80030a00/0x7ad3e1a879576b4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850928.213473:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b80030a00/0x7ad3e1a879576b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850928.213492:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b80030a00/0x7ad3e1a879576b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788850928.213545:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788850928.213550:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788850928.213568:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b80030a00/0x7ad3e1a879576b4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850928.213597:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879576b48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9db expref: 8 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850928.213694:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b80030a00/0x7ad3e1a879576b4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9db expref: 7 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850928.213704:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b87c2ac00) 00010000:00010000:3.0:1788850928.214115:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788850928.214119:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b80030a00, rc 0) 00000100:00100000:3.0:1788850928.214483:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4132a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:5631:x1875746000735232:12345-192.168.204.6@tcp:101: Request processed in 2972us (3322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850928.214492:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00010000:00010000:3.0:1788850928.404573:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850929.426037:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850930.450079:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850930.586584:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850930.591645:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000735360 00000100:00100000:2.0:1788850930.591663:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000735360 00000100:00100000:2.0:1788850930.591846:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:2.0:1788850930.591862:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:5684:x1875746000735360:12345-192.168.204.6@tcp:41: 00000004:00000024:2.0:1788850930.591910:0:5863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788850930.592018:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:5684:x1875746000735360:12345-192.168.204.6@tcp:41: Request processed in 162us (5443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850930.592026:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:3.0:1788850930.595484:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850930.596113:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000735488 00000100:00100000:0.0:1788850930.596127:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000735488 00000100:00080000:1.0:1788850930.596261:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788850930.596267:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788850930.596475:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:0.0:1788850930.596488:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:5684:x1875746000735488:12345-192.168.204.6@tcp:13: 00002000:00000024:0.0:1788850930.596532:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788850930.596619:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3665500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:5684:x1875746000735488:12345-192.168.204.6@tcp:13: Request processed in 134us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850930.596627:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:3.0:1788850930.600560:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850930.600718:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000735616 00000100:00100000:0.0:1788850930.600729:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000735616 00000100:00100000:0.0:1788850930.600842:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:0.0:1788850930.600855:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:5684:x1875746000735616:12345-192.168.204.6@tcp:13: 00002000:00000024:0.0:1788850930.600896:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788850930.600972:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3665180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:5684:x1875746000735616:12345-192.168.204.6@tcp:13: Request processed in 121us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850930.600979:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00080000:1.0:1788850930.601051:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788850931.473987:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788850932.292395:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3c328062-9d4c-41e6-ae57-f4af3bf37898 00000001:00100000:1.0:1788850932.292648:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c328062-9d4c-41e6-ae57-f4af3bf37898 00000001:00100000:2.0:1788850932.296325:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c328062-9d4c-41e6-ae57-f4af3bf37898 00010000:00010000:3.0:1788850932.498181:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850932.754094:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019630976:0@lo:400: 00000100:00100000:1.0:1788850932.754172:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850932.754255:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875746019631488:0@lo:400: 00000100:00100000:1.0:1788850932.754284:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850932.754325:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788850932.754331:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019631104:0@lo:400: 00000100:00100000:1.0:1788850932.754354:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850932.754370:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019631616:0@lo:400: 00000100:00100000:1.0:1788850932.754393:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850932.754567:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019631232:0@lo:400: 00000100:00100000:2.0:1788850932.754600:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850932.754635:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788850932.754641:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019631360:0@lo:400: 00000100:00100000:2.0:1788850932.754664:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850932.754709:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019631488 00000100:00100000:2.0:1788850932.754717:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019631488 00000100:00100000:2.0:1788850932.754770:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019631104 00000100:00100000:2.0:1788850932.754774:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019631104 00000100:00100000:2.0:1788850932.754808:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019631232 00000100:00100000:2.0:1788850932.754812:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019631232 00000100:00100000:2.0:1788850932.754831:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788850932.754840:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875746019631488:12345-0@lo:400: 00000100:00100000:2.0:1788850932.754890:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875746019631488:12345-0@lo:400: Request processed in 51us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850932.754898:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788850932.754928:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788850932.754935:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019631104:12345-0@lo:400: 00000100:00100000:2.0:1788850932.754965:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4132300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019631104:12345-0@lo:400: Request processed in 31us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850932.754970:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788850932.754981:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788850932.754987:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019631232:12345-0@lo:400: 00000100:00100000:2.0:1788850932.755028:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019631232:12345-0@lo:400: Request processed in 42us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850932.755035:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788850932.755059:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019631616 00000100:00100000:2.0:1788850932.755063:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019631616 00000100:00100000:2.0:1788850932.755089:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019631360 00000100:00100000:2.0:1788850932.755091:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019631360 00000100:00100000:2.0:1788850932.755106:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788850932.755111:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019631616:12345-0@lo:400: 00000100:00100000:2.0:1788850932.755141:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4131180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019631616:12345-0@lo:400: Request processed in 30us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850932.755146:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788850932.755156:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788850932.755162:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019631360:12345-0@lo:400: 00000100:00100000:2.0:1788850932.755190:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019631360:12345-0@lo:400: Request processed in 28us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850932.755195:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788850932.755209:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788850932.755212:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788850932.755215:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788850932.755252:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc18c0700 x1875746019631360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850932.755266:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019631360:0@lo:400: 00000100:00100000:3.0:1788850932.755275:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019631104:0@lo:400: 00000100:00100000:2.0:1788850932.755276:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019631232:0@lo:400: 00010000:00080000:3.0:1788850932.755286:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc18c1c00 x1875746019631616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850932.755295:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019631616:0@lo:400: 00000100:00100000:3.0:1788850932.755305:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875746019631488:0@lo:400: 00000100:00100000:0.0:1788850932.755651:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019630976 00000100:00100000:0.0:1788850932.755657:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019630976 00000100:00100000:0.0:1788850932.755705:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788850932.755713:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019630976:12345-0@lo:400: 00000100:00100000:0.0:1788850932.755754:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019630976:12345-0@lo:400: Request processed in 43us (1582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850932.755760:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788850932.756083:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788850932.756097:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019631744:0@lo:13: 00000100:00100000:3.0:1788850932.756135:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850932.756184:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019630976:0@lo:400: 00000100:00100000:0.0:1788850932.756927:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019631744 00000100:00100000:0.0:1788850932.756935:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019631744 00000100:00100000:0.0:1788850932.757035:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788850932.757045:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019631744:12345-0@lo:13: 00002000:00000024:0.0:1788850932.757077:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788850932.757141:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019631744:12345-0@lo:13: Request processed in 97us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850932.757147:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788850932.757234:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bb4130380 x1875746019631744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850948 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850932.757269:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019631744:0@lo:13: 00000100:00100000:2.0:1788850933.251677:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850933.253000:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000735744 00000100:00100000:3.0:1788850933.253028:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000735744 00000100:00100000:3.0:1788850933.253129:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 130 00000100:00100000:3.0:1788850933.253141:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+10:2354:x1875746000735744:12345-192.168.204.6@tcp:400: 00000100:00100000:3.0:1788850933.253281:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+10:2354:x1875746000735744:12345-192.168.204.6@tcp:400: Request processed in 141us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850933.253290:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 130 00000100:00100000:2.0:1788850933.260040:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850933.260106:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850933.260134:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850933.260198:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736128 00000100:00100000:2.0:1788850933.260212:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736128 00000100:00100000:0.0:1788850933.260251:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736000 00000100:00100000:0.0:1788850933.260265:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736000 00000100:00100000:2.0:1788850933.260296:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:2.0:1788850933.260311:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000736128:12345-192.168.204.6@tcp:400: 00000100:00100000:0.0:1788850933.260360:0:6704:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788850933.260371:0:6704:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788850933.260485:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:0.0:1788850933.260495:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000736000:12345-192.168.204.6@tcp:400: 00000100:00100000:0.0:1788850933.260690:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000736000:12345-192.168.204.6@tcp:400: Request processed in 196us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850933.260699:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:3.0:1788850933.260727:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000735872 00000100:00100000:3.0:1788850933.260735:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000735872 00000100:00100000:3.0:1788850933.260837:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:3.0:1788850933.260848:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000735872:12345-192.168.204.6@tcp:400: 00000100:00100000:3.0:1788850933.260901:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000735872:12345-192.168.204.6@tcp:400: Request processed in 56us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850933.260909:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:2.0:1788850933.261152:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000736128:12345-192.168.204.6@tcp:400: Request processed in 844us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850933.261160:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00080000:2.0:1788850933.261183:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788850933.261596:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788850933.261600:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788850933.272332:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019631872:0@lo:13: 00000100:00100000:1.0:1788850933.272414:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850933.273418:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019631872 00000100:00100000:0.0:1788850933.273429:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019631872 00000100:00100000:0.0:1788850933.273522:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788850933.273534:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019631872:12345-0@lo:13: 00002000:00000024:0.0:1788850933.273573:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788850933.273643:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4131500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019631872:12345-0@lo:13: Request processed in 113us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850933.273650:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788850933.273770:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bb4130380 x1875746019631872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850949 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850933.273804:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019631872:0@lo:13: 00010000:00010000:3.0:1788850933.525874:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788850933.879367:0:8311:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788850934.546539:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850935.571298:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850936.594483:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850937.619333:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788850937.741052:0:8458:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe1d66d290 20000000:00000080:2.0:1788850937.741071:0:8458:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a9baff18800 uarg=0000000000000000 20000000:01000000:2.0:1788850937.741114:0:8458:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788850937.741117:0:8458:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788850937.741120:0:8458:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788850937.741125:0:8458:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788850937.741130:0:8458:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788850937.741148:0:8458:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788850937.741151:0:8458:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788850937.741424:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788850937.741427:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788850937.744113:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788850937.745035:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788850937.745108:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788850937.745145:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788850937.745161:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788850937.745163:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788850937.746763:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788850937.747699:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788850937.747744:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788850937.747776:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1788850937.748015:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788850937.748018:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788850937.749373:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788850937.750417:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788850937.750566:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788850937.750604:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788850937.750621:0:8458:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788850937.750632:0:8458:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788850937.752299:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788850937.753112:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788850937.753165:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788850937.753291:0:8458:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:3.0:1788850937.753309:0:8458:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788850937.753330:0:8458:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9b80030c00/0x7ad3e1a879576b56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.753350:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a2a00/0x7ad3e1a879576a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576a4c expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.753358:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576a7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576a76 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.753365:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879576aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576aa0 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.753372:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a5800/0x7ad3e1a879576ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576aae expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.753379:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b98af7e00/0x7ad3e1a879576ac3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576abc expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.753386:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576adf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576ad8 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.753393:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576b09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576b02 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.753403:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b8168fa00/0x7ad3e1a879576b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe979 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.753423:0:8458:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879576b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe980 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.753431:0:8458:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9b80030c00/0x7ad3e1a879576b56 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.753546:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879576b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe980 expref: 9 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.753564:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879576b1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe980 expref: 9 pid: 5853 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850937.753579:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632000:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788850937.753759:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b8168fa00/0x7ad3e1a879576b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe979 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.753768:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9b8168fa00/0x7ad3e1a879576b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe979 expref: 9 pid: 5856 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850937.753776:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf043100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632128:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788850937.753864:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576b02 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.753872:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576b09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576b02 expref: 18 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850937.753881:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632256:0@lo:104: 00000100:00100000:3.0:1788850937.753930:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788850937.753981:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576ad8 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.753990:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576adf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576ad8 expref: 18 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850937.753998:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf041f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632384:0@lo:104: 00000100:00100000:3.0:1788850937.754024:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788850937.754046:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b98af7e00/0x7ad3e1a879576ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576abc expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.754053:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b98af7e00/0x7ad3e1a879576ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576abc expref: 18 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850937.754060:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632512:0@lo:104: 00010000:00010000:3.0:1788850937.754082:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a5800/0x7ad3e1a879576ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576aae expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.754088:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a5800/0x7ad3e1a879576ab5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576aae expref: 18 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850937.754095:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf043480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632640:0@lo:104: 00010000:00010000:3.0:1788850937.754114:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879576aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576aa0 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.754121:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879576aa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576aa0 expref: 18 pid: 5853 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850937.754129:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632768:0@lo:104: 00010000:00010000:3.0:1788850937.754147:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576a76 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.754163:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576a7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576a76 expref: 18 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850937.754171:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632896:0@lo:104: 00010000:00010000:3.0:1788850937.754387:0:8458:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a2a00/0x7ad3e1a879576a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576a4c expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.754398:0:8458:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a2a00/0x7ad3e1a879576a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576a4c expref: 18 pid: 5856 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850937.754406:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019633024:0@lo:104: 00000100:00100000:3.0:1788850937.754428:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c09840 going to sleep for 11 seconds 00000100:00100000:1.0:1788850937.754608:0:5844:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788850937.754628:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850937.754641:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850937.754649:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850937.754658:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850937.754665:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850937.754674:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019632256 00000100:00100000:1.0:1788850937.754682:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019632256 00000100:00100000:1.0:1788850937.754719:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019632384 00000100:00100000:1.0:1788850937.754722:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019632384 00000100:00100000:1.0:1788850937.754731:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019632512 00000100:00100000:1.0:1788850937.754734:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019632512 00000100:00100000:1.0:1788850937.754742:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019632640 00000100:00100000:1.0:1788850937.754745:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019632640 00000100:00100000:1.0:1788850937.754753:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019632768 00000100:00100000:1.0:1788850937.754756:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019632768 00000100:00100000:1.0:1788850937.754763:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019632896 00000100:00100000:1.0:1788850937.754765:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019632896 00000100:00100000:1.0:1788850937.754773:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633024 00000100:00100000:1.0:1788850937.754775:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633024 00000100:00100000:1.0:1788850937.754808:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788850937.754830:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf041880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+9:8458:x1875746019632256:12345-0@lo:104: 00010000:00010000:1.0:1788850937.754845:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a879576b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576b09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.754900:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788850937.754912:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf041880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+9:8458:x1875746019632256:12345-0@lo:104: Request processed in 86us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850937.754931:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788850937.755126:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632256:0@lo:104: 00000100:00100000:1.0:1788850937.755166:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788850937.755175:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ded450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+8:8458:x1875746019632384:12345-0@lo:104: 00010000:00010000:1.0:1788850937.755183:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4a00/0x7ad3e1a879576ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576adf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.755309:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788850937.755315:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ded450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+8:8458:x1875746019632384:12345-0@lo:104: Request processed in 142us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850937.755321:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788850937.755352:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788850937.755360:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4133b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+7:8458:x1875746019632512:12345-0@lo:104: 00010000:00010000:1.0:1788850937.755369:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879576abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576ac3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.755402:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788850937.755407:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4133b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+7:8458:x1875746019632512:12345-0@lo:104: Request processed in 49us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850937.755413:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788850937.755425:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788850937.755431:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4130700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+6:8458:x1875746019632640:12345-0@lo:104: 00010000:00010000:1.0:1788850937.755439:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576ab5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.755544:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788850937.755556:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4130700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+6:8458:x1875746019632640:12345-0@lo:104: Request processed in 125us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850937.755561:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788850937.755573:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788850937.755579:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+5:8458:x1875746019632768:12345-0@lo:104: 00010000:00010000:1.0:1788850937.755587:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6c00/0x7ad3e1a879576aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576aa7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.755624:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788850937.755629:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4132680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+5:8458:x1875746019632768:12345-0@lo:104: Request processed in 51us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850937.755635:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788850937.755648:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788850937.755654:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4130380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+4:8458:x1875746019632896:12345-0@lo:104: 00010000:00010000:1.0:1788850937.755661:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7800/0x7ad3e1a879576a76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576a7d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.755688:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788850937.755693:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4130380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+4:8458:x1875746019632896:12345-0@lo:104: Request processed in 40us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850937.755699:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788850937.755709:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788850937.755714:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+3:8458:x1875746019633024:12345-0@lo:104: 00010000:00010000:1.0:1788850937.755721:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e600/0x7ad3e1a879576a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576a53 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.755745:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1788850937.755755:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4132d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+3:8458:x1875746019633024:12345-0@lo:104: Request processed in 41us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850937.755760:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788850937.755801:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788850937.755808:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a879576b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576b09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.756094:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168e000 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:1.0:1788850937.756099:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a879576b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576b09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.756109:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a879576b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576b09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788850937.756116:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a879576b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576b09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850937.756122:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788850937.756232:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf041f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632384:0@lo:104: 00000100:00100000:3.0:1788850937.756241:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632512:0@lo:104: 00000100:00100000:3.0:1788850937.756247:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf043480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632640:0@lo:104: 00000100:00100000:3.0:1788850937.756254:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632768:0@lo:104: 00000100:00100000:3.0:1788850937.756261:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632896:0@lo:104: 00000100:00100000:3.0:1788850937.756267:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019633024:0@lo:104: 00010000:00010000:1.0:1788850937.756319:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a879576b02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576b09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.756325:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788850937.756349:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a879576b02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576b09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.756356:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e000/0x7ad3e1a879576b02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576b09 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.756372:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788850937.756376:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4a00/0x7ad3e1a879576ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576adf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.756392:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4a00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:1.0:1788850937.756395:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4a00/0x7ad3e1a879576ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576adf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.756402:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4a00/0x7ad3e1a879576ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576adf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788850937.756408:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4a00/0x7ad3e1a879576ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576adf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850937.756414:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788850937.756445:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019633152:0@lo:103: 00000100:00100000:3.0:1788850937.756492:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850937.756806:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633152 00000100:00100000:0.0:1788850937.756823:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633152 00010000:00010000:0.0:1788850937.756850:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576b09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576b02 expref: 19 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850937.756874:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788850937.756881:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019633152:12345-0@lo:103: 00010000:00010000:0.0:1788850937.756891:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850937.756896:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576b09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576b02 expref: 19 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.756906:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576b09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576b02 expref: 19 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.756932:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576b09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576b02 expref: 19 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.756964:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850937.756997:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf042300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:3308:x1875746019633152:12345-0@lo:103: Request processed in 117us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850937.757003:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788850937.757036:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019633152:0@lo:103: 00010000:00010000:0.0:1788850937.757068:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788850937.757073:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879576abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576ac3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.757079:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6400 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788850937.757082:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879576abc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576ac3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.757089:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879576abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576ac3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850937.757096:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879576abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576ac3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850937.757101:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788850937.757484:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4a00/0x7ad3e1a879576ad8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576adf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757492:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788850937.757531:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788850937.757550:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4a00/0x7ad3e1a879576ad8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576adf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757558:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4a00/0x7ad3e1a879576ad8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576adf expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757570:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788850937.757573:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576ab5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757579:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ec00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:1.0:1788850937.757582:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576aae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576ab5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757601:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576ab5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788850937.757607:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576ab5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850937.757613:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788850937.757628:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576aae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576ab5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757634:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788850937.757648:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576aae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576ab5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757656:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576aae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576ab5 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757665:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788850937.757668:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6c00/0x7ad3e1a879576aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576aa7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757672:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6c00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:1.0:1788850937.757674:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6c00/0x7ad3e1a879576aa0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576aa7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757682:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6c00/0x7ad3e1a879576aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576aa7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788850937.757688:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6c00/0x7ad3e1a879576aa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576aa7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850937.757699:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788850937.757713:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6c00/0x7ad3e1a879576aa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576aa7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757718:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788850937.757724:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6c00/0x7ad3e1a879576aa0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576aa7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757730:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6c00/0x7ad3e1a879576aa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576aa7 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757740:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788850937.757743:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7800/0x7ad3e1a879576a76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576a7d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757748:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7800 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:1.0:1788850937.757750:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7800/0x7ad3e1a879576a76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576a7d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757757:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7800/0x7ad3e1a879576a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576a7d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788850937.757763:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7800/0x7ad3e1a879576a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576a7d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850937.757768:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788850937.757796:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7800/0x7ad3e1a879576a76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576a7d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.757802:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788850937.761126:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019633664:0@lo:103: 00000100:00100000:3.0:1788850937.761332:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850937.761406:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019633280:0@lo:103: 00000100:00100000:3.0:1788850937.761431:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788850937.761642:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879576abc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576ac3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.761655:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850937.761676:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879576abc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576ac3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.761684:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879576abc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576ac3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.761709:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788850937.761713:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e600/0x7ad3e1a879576a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576a53 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.761719:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168e600 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788850937.761723:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e600/0x7ad3e1a879576a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576a53 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.761732:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e600/0x7ad3e1a879576a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576a53 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788850937.761738:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e600/0x7ad3e1a879576a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576a53 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850937.761744:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788850937.761760:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e600/0x7ad3e1a879576a4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576a53 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.761765:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788850937.761769:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e600/0x7ad3e1a879576a4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576a53 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.761775:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b8168e600/0x7ad3e1a879576a4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576a53 expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.761805:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850937.761806:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850937.761808:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850937.761824:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850937.761839:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788850937.761858:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019633792:0@lo:103: 00000100:00100000:0.0:1788850937.761885:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850937.761913:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633664 00000100:00100000:0.0:1788850937.761932:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633664 00010000:00010000:0.0:1788850937.762443:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576a7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576a76 expref: 18 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.762503:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7800/0x7ad3e1a879576a76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576a7d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.762512:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7800/0x7ad3e1a879576a76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576a7d expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850937.762527:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850937.762529:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850937.762531:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850937.762545:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633280 00000100:00100000:0.0:1788850937.762549:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633280 00010000:00010000:0.0:1788850937.762563:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576adf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576ad8 expref: 19 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850937.762574:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633792 00000100:00100000:0.0:1788850937.762576:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633792 00010000:00010000:0.0:1788850937.762586:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b98af7e00/0x7ad3e1a879576ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576abc expref: 20 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850937.762599:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788850937.762606:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+20:3308:x1875746019633664:12345-0@lo:103: 00010000:00010000:0.0:1788850937.762619:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788850937.762624:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019633408:0@lo:103: 00010000:00010000:0.0:1788850937.762624:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576a7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576a76 expref: 20 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.762634:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576a76 expref: 20 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.762647:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576a7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576a76 expref: 20 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850937.762658:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788850937.762659:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850937.762694:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019633664:12345-0@lo:103: Request processed in 88us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850937.762701:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788850937.762719:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633408 00000100:00100000:0.0:1788850937.762722:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633408 00010000:00010000:0.0:1788850937.762733:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a5800/0x7ad3e1a879576ab5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576aae expref: 19 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850937.762745:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788850937.762750:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019633280:12345-0@lo:103: 00000100:00100000:1.0:1788850937.762753:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019633920:0@lo:103: 00010000:00010000:0.0:1788850937.762757:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850937.762761:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576adf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576ad8 expref: 19 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.762769:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576adf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576ad8 expref: 19 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850937.762773:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788850937.762797:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576adf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576ad8 expref: 19 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.762807:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788850937.762809:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788850937.762815:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019633536:0@lo:103: 00000100:00100000:1.0:1788850937.762836:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850937.762886:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019633664:0@lo:103: 00000100:00100000:2.0:1788850937.763302:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633920 00000100:00100000:2.0:1788850937.763306:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633920 00010000:00010000:2.0:1788850937.763326:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a2a00/0x7ad3e1a879576a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576a4c expref: 19 pid: 5856 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850937.763338:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019633536 00000100:00100000:2.0:1788850937.763340:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019633536 00010000:00010000:2.0:1788850937.763349:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879576aa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576aa0 expref: 20 pid: 5853 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850937.763360:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788850937.763366:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+20:3308:x1875746019633792:12345-0@lo:103: 00010000:00010000:2.0:1788850937.763373:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788850937.763377:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b98af7e00/0x7ad3e1a879576ac3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576abc expref: 20 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850937.763385:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b98af7e00/0x7ad3e1a879576ac3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576abc expref: 20 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850937.763394:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af7e00/0x7ad3e1a879576ac3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576abc expref: 20 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850937.763402:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850937.763554:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019633792:0@lo:103: 00000100:00100000:0.0:1788850937.763623:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf040380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019633280:12345-0@lo:103: Request processed in 872us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850937.763629:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788850937.763646:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788850937.763653:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:3310:x1875746019633408:12345-0@lo:103: 00010000:00010000:0.0:1788850937.763661:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850937.763665:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a5800/0x7ad3e1a879576ab5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576aae expref: 18 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.763686:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a5800/0x7ad3e1a879576ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576aae expref: 18 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.763696:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a5800/0x7ad3e1a879576ab5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576aae expref: 18 pid: 5855 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.763706:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850937.763730:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:3310:x1875746019633408:12345-0@lo:103: Request processed in 78us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850937.763735:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788850937.763748:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788850937.763754:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+16:3310:x1875746019633920:12345-0@lo:103: 00010000:00010000:0.0:1788850937.763760:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850937.763764:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a2a00/0x7ad3e1a879576a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576a4c expref: 16 pid: 5856 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.763772:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a2a00/0x7ad3e1a879576a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576a4c expref: 16 pid: 5856 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.763805:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a2a00/0x7ad3e1a879576a53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576a4c expref: 16 pid: 5856 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850937.763934:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019633280:0@lo:103: 00000100:00100000:2.0:1788850937.764036:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+15:3308:x1875746019633792:12345-0@lo:103: Request processed in 669us (2148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850937.764043:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788850937.764058:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788850937.764065:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86785450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+14:3310:x1875746019633536:12345-0@lo:103: 00010000:00010000:2.0:1788850937.764073:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788850937.764078:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879576aa7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576aa0 expref: 14 pid: 5853 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850937.764086:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879576aa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576aa0 expref: 14 pid: 5853 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850937.764095:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879576aa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576aa0 expref: 14 pid: 5853 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850937.764104:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788850937.764127:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86785450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+13:3310:x1875746019633536:12345-0@lo:103: Request processed in 64us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850937.764134:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788850937.764376:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99173b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019633536:0@lo:103: 00000100:00100000:1.0:1788850937.764385:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99172300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019633408:0@lo:103: 00000100:00100000:3.0:1788850937.764450:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3664e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632000:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788850937.764543:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf043100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8458:1875746019632128:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788850937.764588:0:8458:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9b80030c00/0x7ad3e1a879576b56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.764626:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850937.764701:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+12:3310:x1875746019633920:12345-0@lo:103: Request processed in 947us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850937.764708:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788850937.765134:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019633920:0@lo:103: 00000100:00100000:2.0:1788850937.771273:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850937.771335:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850937.771514:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736256 00000100:00100000:3.0:1788850937.771532:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736256 00010000:00010000:3.0:1788850937.771589:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879576b1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe980 expref: 10 pid: 5853 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850937.771636:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736384 00000100:00100000:3.0:1788850937.771640:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736384 00010000:00010000:3.0:1788850937.771654:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b8168fa00/0x7ad3e1a879576b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe979 expref: 11 pid: 5856 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850937.771678:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:3.0:1788850937.771690:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6835cbef-1345-4ac2-988d-7ad135109255+11:2353:x1875746000736256:12345-192.168.204.6@tcp:103: 00010000:00010000:3.0:1788850937.771711:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788850937.771718:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879576b1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe980 expref: 11 pid: 5853 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.771740:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879576b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe980 expref: 11 pid: 5853 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850937.771741:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:0.0:1788850937.771768:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6835cbef-1345-4ac2-988d-7ad135109255+11:2354:x1875746000736384:12345-192.168.204.6@tcp:103: 00010000:00010000:3.0:1788850937.771829:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879576b1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe980 expref: 11 pid: 5853 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850937.771853:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788850937.771947:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6835cbef-1345-4ac2-988d-7ad135109255+10:2353:x1875746000736256:12345-192.168.204.6@tcp:103: Request processed in 258us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850937.771956:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 19 00010000:00010000:0.0:1788850937.772294:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788850937.772305:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b8168fa00/0x7ad3e1a879576b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe979 expref: 9 pid: 5856 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.772322:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b8168fa00/0x7ad3e1a879576b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe979 expref: 9 pid: 5856 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.772341:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b8168fa00/0x7ad3e1a879576b17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe979 expref: 9 pid: 5856 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.772361:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9b80030c00/0x7ad3e1a879576b56 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.772369:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b80030c00/0x7ad3e1a879576b56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.772660:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b80030c00/0x7ad3e1a879576b56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.772669:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b80030c00/0x7ad3e1a879576b56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.772675:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9b80030c00/0x7ad3e1a879576b56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.772683:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9b80030c00/0x7ad3e1a879576b56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.772689:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b80030c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788850937.772694:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9b80030c00/0x7ad3e1a879576b56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.772715:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9b80030c00/0x7ad3e1a879576b56 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.772734:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9b80030c00/0x7ad3e1a879576b56 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850937.772772:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788850937.772852:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6835cbef-1345-4ac2-988d-7ad135109255+8:2354:x1875746000736384:12345-192.168.204.6@tcp:103: Request processed in 1094us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850937.772863:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 20 00010000:00010000:2.0:1788850937.780603:0:8458:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9b80030c00/0x7ad3e1a879576b56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850937.780628:0:8458:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9b80030c00/0x7ad3e1a879576b56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850937.780636:0:8458:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b80030c00/0x7ad3e1a879576b56 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850937.874648:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019634048:0@lo:400: 00000100:00100000:2.0:1788850937.874746:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850937.875187:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019634560:0@lo:400: 00000100:00100000:2.0:1788850937.875226:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850937.875270:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788850937.875277:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019634432:0@lo:400: 00000100:00100000:2.0:1788850937.875305:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850937.875342:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019634304:0@lo:400: 00000100:00100000:3.0:1788850937.875365:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019634176:0@lo:400: 00000100:00100000:2.0:1788850937.875402:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850937.875414:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850937.875443:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634048 00000100:00100000:2.0:1788850937.875452:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634048 00000100:00100000:2.0:1788850937.875504:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634432 00000100:00100000:2.0:1788850937.875507:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634432 00000100:00100000:2.0:1788850937.875708:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634176 00000100:00100000:2.0:1788850937.875713:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634176 00000100:00100000:2.0:1788850937.875736:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788850937.875746:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019634048:12345-0@lo:400: 00000100:00100000:2.0:1788850937.876232:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019634048:12345-0@lo:400: Request processed in 485us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850937.876241:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788850937.876265:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788850937.876272:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019634432:12345-0@lo:400: 00000100:00100000:2.0:1788850937.876305:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019634432:12345-0@lo:400: Request processed in 35us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850937.876311:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788850937.876322:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788850937.876352:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019634176:12345-0@lo:400: 00000100:00100000:0.0:1788850937.876979:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019634432:0@lo:400: 00000100:00100000:0.0:1788850937.877007:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019634048:0@lo:400: 00000100:00100000:2.0:1788850937.877210:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019634176:12345-0@lo:400: Request processed in 858us (1795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850937.877218:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788850937.877250:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634560 00000100:00100000:2.0:1788850937.877257:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634560 00000100:00100000:2.0:1788850937.877303:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634304 00000100:00100000:2.0:1788850937.877306:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634304 00000100:00100000:2.0:1788850937.877329:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788850937.877337:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019634560:12345-0@lo:400: 00000100:00100000:0.0:1788850937.877750:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788850937.877765:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019634304:12345-0@lo:400: 00000100:00100000:2.0:1788850937.877950:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019634560:12345-0@lo:400: Request processed in 614us (2722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850937.877958:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788850937.877981:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788850937.877986:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788850937.877990:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788850937.878172:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019634304:12345-0@lo:400: Request processed in 414us (2771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850937.878180:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788850937.878225:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b87d77b80 x1875746019634304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850937.878239:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019634304:0@lo:400: 00000100:00100000:0.0:1788850937.878278:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019634176:0@lo:400: 00010000:00080000:0.0:1788850937.878304:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf4d2300 x1875746019634560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850937.878314:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019634560:0@lo:400: 00000100:00100000:0.0:1788850937.882690:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788850937.882726:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019634688:0@lo:13: 00000100:00100000:0.0:1788850937.886951:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850937.892964:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634688 00000100:00100000:2.0:1788850937.893138:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634688 00000100:00100000:2.0:1788850937.893214:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788850937.893227:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019634688:12345-0@lo:13: 00002000:00000024:2.0:1788850937.893280:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788850937.893613:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019634688:12345-0@lo:13: Request processed in 388us (6673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850937.893623:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788850937.893730:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc18c0e00 x1875746019634688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850937.893757:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019634688:0@lo:13: 00000100:00100000:1.0:1788850938.372774:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850938.372862:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850938.372925:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850938.372958:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850938.372993:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736512 00000100:00100000:1.0:1788850938.373016:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736512 00000100:00100000:1.0:1788850938.373117:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 131 00000100:00100000:1.0:1788850938.373130:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+8:2351:x1875746000736512:12345-192.168.204.6@tcp:400: 00000100:00100000:1.0:1788850938.373237:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+8:2351:x1875746000736512:12345-192.168.204.6@tcp:400: Request processed in 109us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850938.373246:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 131 00000100:00100000:1.0:1788850938.373290:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736896 00000100:00100000:1.0:1788850938.373295:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736896 00000100:00100000:1.0:1788850938.373333:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736768 00000100:00100000:1.0:1788850938.373336:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736768 00000100:00100000:1.0:1788850938.373359:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:1.0:1788850938.373366:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2351:x1875746000736896:12345-192.168.204.6@tcp:400: 00000100:00100000:1.0:1788850938.373400:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2351:x1875746000736896:12345-192.168.204.6@tcp:400: Request processed in 35us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850938.373407:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:1.0:1788850938.373419:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:1.0:1788850938.373426:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2351:x1875746000736768:12345-192.168.204.6@tcp:400: 00000100:00100000:1.0:1788850938.373452:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2351:x1875746000736768:12345-192.168.204.6@tcp:400: Request processed in 27us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850938.373458:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:3.0:1788850938.373963:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000736640 00000100:00100000:3.0:1788850938.373971:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000736640 00000100:00100000:3.0:1788850938.374097:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:3.0:1788850938.374108:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2351:x1875746000736640:12345-192.168.204.6@tcp:400: 00000100:00100000:3.0:1788850938.374162:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2351:x1875746000736640:12345-192.168.204.6@tcp:400: Request processed in 56us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850938.374172:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00080000:2.0:1788850938.375029:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788850938.375038:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788850938.375041:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788850938.386399:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788850938.386438:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019634816:0@lo:13: 00000100:00100000:0.0:1788850938.386530:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850938.386618:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634816 00000100:00100000:0.0:1788850938.386628:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634816 00000100:00100000:0.0:1788850938.386693:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788850938.386703:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019634816:12345-0@lo:13: 00002000:00000024:0.0:1788850938.386748:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788850938.386830:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019634816:12345-0@lo:13: Request processed in 128us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850938.386838:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788850938.387248:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc18c0e00 x1875746019634816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850954 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850938.387274:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019634816:0@lo:13: 00010000:00010000:0.0:1788850938.645400:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788850939.537932:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788850939.537950:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a9b866a7000 from 39 10000000:01000000:3.0:1788850939.537956:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788850939.538065:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850939.538079:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850939.538093:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850939.538141:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019634944:0@lo:101: 00000100:00100000:3.0:1788850939.538225:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850939.538310:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c09840 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.538511:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019634944 00000100:00100000:0.0:1788850939.538520:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019634944 00000100:00100000:0.0:1788850939.538580:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788850939.538590:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+12:5858:x1875746019634944:12345-0@lo:101: 00010000:00010000:0.0:1788850939.538605:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850939.538645:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af6400/0x7ad3e1a879576b64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576b5d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850939.538671:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af6400/0x7ad3e1a879576b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576b5d expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850939.538682:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af6400/0x7ad3e1a879576b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576b5d expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850939.538692:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6400, rc 0) 00000100:00100000:0.0:1788850939.538738:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:5858:x1875746019634944:12345-0@lo:101: Request processed in 150us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.538745:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788850939.538844:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019634944:0@lo:101: 00010000:00010000:2.0:1788850939.538870:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850939.538880:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576b64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850939.538964:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019635072:0@lo:501: 00000100:00100000:2.0:1788850939.538995:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850939.539025:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.539135:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635072 00000100:00100000:0.0:1788850939.539140:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635072 00000100:00100000:0.0:1788850939.539173:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788850939.539180:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+13:5858:x1875746019635072:12345-0@lo:501: 00000100:00100000:0.0:1788850939.539456:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+13:5858:x1875746019635072:12345-0@lo:501: Request processed in 276us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.539471:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788850939.539744:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019635072:0@lo:501: 00000100:00100000:2.0:1788850939.539773:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019635200:0@lo:503: 00000100:00100000:2.0:1788850939.539831:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850939.539859:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788850939.539925:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635200 00000100:00100000:1.0:1788850939.539930:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635200 00000100:00100000:1.0:1788850939.539983:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788850939.539992:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:5858:x1875746019635200:12345-0@lo:503: 00000100:00100000:1.0:1788850939.540176:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+13:5858:x1875746019635200:12345-0@lo:503: Request processed in 184us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850939.540183:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788850939.540433:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019635200:0@lo:503: 00000100:00100000:2.0:1788850939.541216:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8475:1875746019635328:0@lo:502: 00000100:00100000:2.0:1788850939.541282:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850939.541319:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.541450:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635328 00000100:00100000:0.0:1788850939.541457:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635328 00000100:00100000:0.0:1788850939.541499:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788850939.541506:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+13:8475:x1875746019635328:12345-0@lo:502: 00000100:00100000:0.0:1788850939.541732:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+13:8475:x1875746019635328:12345-0@lo:502: Request processed in 226us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.541741:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788850939.542066:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8475:1875746019635328:0@lo:502: 00000100:00100000:2.0:1788850939.542115:0:8475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8475:1875746019635456:0@lo:502: 00000100:00100000:2.0:1788850939.542148:0:8475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850939.542178:0:8475:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.542355:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635456 00000100:00100000:0.0:1788850939.542360:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635456 00000100:00100000:0.0:1788850939.542454:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788850939.542462:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:8475:x1875746019635456:12345-0@lo:502: 00000100:00100000:0.0:1788850939.542631:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+13:8475:x1875746019635456:12345-0@lo:502: Request processed in 169us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.542637:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788850939.542710:0:8475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8475:1875746019635456:0@lo:502: 00000040:00080000:3.0:1788850939.542733:0:8475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788850939.549071:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788850939.549115:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788850939.549127:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.549141:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850939.549153:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788850939.549156:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788850939.549160:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788850939.549213:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.549221:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.549233:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850939.549259:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019635584:0@lo:101: 00000100:00100000:1.0:1788850939.549323:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850939.553244:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788850939.553408:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635584 00000100:00100000:2.0:1788850939.553419:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635584 00000100:00100000:2.0:1788850939.553565:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788850939.553574:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+13:5858:x1875746019635584:12345-0@lo:101: 00010000:00010000:2.0:1788850939.553607:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850939.553626:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a2000/0x7ad3e1a879576b72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576b6b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850939.553656:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a2000/0x7ad3e1a879576b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576b6b expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850939.553667:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a2000/0x7ad3e1a879576b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576b6b expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850939.553676:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a2000, rc 0) 00000100:00100000:2.0:1788850939.553807:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019635584:12345-0@lo:101: Request processed in 233us (4483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850939.553814:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788850939.554174:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019635584:0@lo:101: 00010000:00010000:1.0:1788850939.554193:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.554203:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576b72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850939.559145:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019635712:0@lo:501: 00000100:00100000:1.0:1788850939.559228:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850939.559435:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788850939.559712:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635712 00000100:00100000:2.0:1788850939.559720:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635712 00000100:00100000:2.0:1788850939.561618:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788850939.561644:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019635712:12345-0@lo:501: 00000100:00100000:2.0:1788850939.562094:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019635712:12345-0@lo:501: Request processed in 461us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850939.562103:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788850939.562272:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019635712:0@lo:501: 00000100:00100000:1.0:1788850939.562330:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019635840:0@lo:503: 00000100:00100000:1.0:1788850939.562394:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850939.564096:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.564728:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635840 00000100:00100000:0.0:1788850939.564739:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635840 00000100:00100000:0.0:1788850939.564804:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788850939.564814:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019635840:12345-0@lo:503: 00000100:00100000:0.0:1788850939.565060:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019635840:12345-0@lo:503: Request processed in 246us (2665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.565067:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788850939.565141:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019635840:0@lo:503: 00000100:00100000:0.0:1788850939.565358:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8476:1875746019635968:0@lo:502: 00000100:00100000:0.0:1788850939.565404:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850939.565426:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019635968 00000100:00100000:0.0:1788850939.565430:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019635968 00000100:00100000:0.0:1788850939.565448:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788850939.565683:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0300 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.567463:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:8476:x1875746019635968:12345-0@lo:502: 00000100:00100000:0.0:1788850939.568309:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:8476:x1875746019635968:12345-0@lo:502: Request processed in 2851us (2902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.568321:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788850939.573734:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8476:1875746019635968:0@lo:502: 00000020:01000000:1.0:1788850939.573861:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850939.573875:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850939.573877:0:8476:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788850939.573899:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788850939.573947:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8476:1875746019636096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850939.574118:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850939.574155:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.576964:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636096 00000100:00100000:0.0:1788850939.576981:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636096 00000100:00100000:0.0:1788850939.577052:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788850939.577064:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:8476:x1875746019636096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788850939.577366:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+14:8476:x1875746019636096:12345-0@lo:502:llog_process_th.0 Request processed in 304us (3336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.577375:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788850939.577496:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8476:1875746019636096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788850939.577538:0:8476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850939.577546:0:8476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850939.577548:0:8476:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788850939.577556:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788850939.578160:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788850939.578187:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788850939.578197:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850939.578210:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850939.578222:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788850939.578225:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a9ba049f800 from 39 10000000:01000000:0.0:1788850939.578228:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788850939.578267:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850939.578276:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850939.578286:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850939.578320:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019636224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788850939.578369:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850939.578498:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788850939.578707:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636224 00000100:00100000:3.0:1788850939.578715:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636224 00000100:00100000:3.0:1788850939.578913:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788850939.578923:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+14:5858:x1875746019636224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788850939.578936:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850939.578950:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b80031800/0x7ad3e1a879576b80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576b79 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850939.578976:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b80031800/0x7ad3e1a879576b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576b79 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850939.578986:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b80031800/0x7ad3e1a879576b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576b79 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850939.578994:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b80031800, rc 0) 00000100:00100000:3.0:1788850939.579050:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019636224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850939.579057:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788850939.579122:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019636224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788850939.579138:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.579164:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576b80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850939.579219:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019636352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788850939.579253:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850939.579493:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.579520:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636352 00000100:00100000:0.0:1788850939.579525:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636352 00000100:00100000:0.0:1788850939.579562:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788850939.579580:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019636352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788850939.579953:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019636352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 374us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.579960:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788850939.580049:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019636352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788850939.580080:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019636480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788850939.580119:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850939.580147:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.580329:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636480 00000100:00100000:0.0:1788850939.580335:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636480 00000100:00100000:0.0:1788850939.580366:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788850939.580373:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019636480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788850939.580731:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019636480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 357us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.580738:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788850939.581005:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019636480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788850939.581549:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8477:1875746019636608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850939.581603:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850939.581638:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.581690:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636608 00000100:00100000:0.0:1788850939.581696:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636608 00000100:00100000:0.0:1788850939.581732:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788850939.581740:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+15:8477:x1875746019636608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788850939.581976:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+15:8477:x1875746019636608:12345-0@lo:502:llog_process_th.0 Request processed in 236us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.581983:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788850939.582502:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8477:1875746019636608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850939.582548:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8477:1875746019636736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850939.582587:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850939.582608:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.582660:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636736 00000100:00100000:0.0:1788850939.582665:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636736 00000100:00100000:0.0:1788850939.582699:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788850939.582706:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+15:8477:x1875746019636736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788850939.583327:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+15:8477:x1875746019636736:12345-0@lo:502:llog_process_th.0 Request processed in 620us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.583336:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788850939.583523:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8477:1875746019636736:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788850939.583548:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788850939.583988:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788850939.584020:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788850939.584029:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850939.584041:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850939.584050:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788850939.584053:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788850939.584055:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788850939.584084:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850939.584092:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850939.584100:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850939.584119:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019636864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788850939.584160:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850939.584195:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0300 going to sleep for 11 seconds 00000100:00100000:3.0:1788850939.584256:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636864 00000100:00100000:3.0:1788850939.584263:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636864 00000100:00100000:3.0:1788850939.584331:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788850939.584341:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+15:5858:x1875746019636864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788850939.584358:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850939.584370:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b80030400/0x7ad3e1a879576b8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576b87 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850939.584461:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b80030400/0x7ad3e1a879576b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576b87 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850939.584473:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b80030400/0x7ad3e1a879576b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576b87 expref: 16 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850939.584482:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b80030400, rc 0) 00000100:00100000:3.0:1788850939.584522:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019636864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850939.584528:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788850939.584587:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019636864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788850939.584599:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850939.584607:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576b8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850939.584652:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019636992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788850939.584683:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850939.585243:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788850939.585457:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019636992 00000100:00100000:1.0:1788850939.585465:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019636992 00000100:00100000:1.0:1788850939.585497:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788850939.585511:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019636992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788850939.585769:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019636992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850939.585777:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788850939.587133:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019636992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788850939.587203:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019637120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788850939.587269:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850939.587303:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788850939.587530:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019637120 00000100:00100000:1.0:1788850939.587537:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019637120 00000100:00100000:1.0:1788850939.587571:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788850939.587579:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019637120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788850939.587759:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019637120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850939.587766:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788850939.587895:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019637120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788850939.588121:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8478:1875746019637248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788850939.588157:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850939.588174:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788850939.588326:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019637248 00000100:00100000:1.0:1788850939.588330:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019637248 00000100:00100000:1.0:1788850939.588348:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788850939.588354:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+16:8478:x1875746019637248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850939.588575:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+16:8478:x1875746019637248:12345-0@lo:502:llog_process_th.0 Request processed in 220us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850939.588581:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788850939.588659:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8478:1875746019637248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788850939.588682:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788850939.588690:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850939.588692:0:8478:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788850939.588697:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788850939.588717:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8478:1875746019637376:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788850939.588749:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850939.588771:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98a21180 going to sleep for 11 seconds 00000100:00100000:3.0:1788850939.588921:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019637376 00000100:00100000:3.0:1788850939.588927:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019637376 00000100:00100000:3.0:1788850939.588952:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788850939.588958:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+16:8478:x1875746019637376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850939.589093:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+16:8478:x1875746019637376:12345-0@lo:502:llog_process_th.0 Request processed in 134us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850939.589100:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788850939.589181:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8478:1875746019637376:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788850939.589201:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788850939.589206:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850939.589207:0:8478:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788850939.589212:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788850939.589494:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788850939.589511:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788850939.589520:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850939.589532:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788850939.589552:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788850939.589555:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a9ba0462000 from 39 10000000:01000000:3.0:1788850939.589558:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788850939.589584:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850939.589592:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850939.589601:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850939.589615:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019637504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788850939.589643:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850939.589672:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c093c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788850939.589709:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019637504 00000100:00100000:1.0:1788850939.589714:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019637504 00000100:00100000:1.0:1788850939.589743:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788850939.589749:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019637504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788850939.589758:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850939.589769:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b8168e400/0x7ad3e1a879576b9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576b95 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.589825:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b8168e400/0x7ad3e1a879576b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576b95 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.589844:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b8168e400/0x7ad3e1a879576b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576b95 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.589853:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168e400, rc 0) 00000100:00100000:1.0:1788850939.589893:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019637504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850939.589899:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788850939.589966:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019637504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788850939.589979:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b9c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850939.589988:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576b9c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788850939.590031:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019637632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850939.590056:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850939.590079:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c093c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.590192:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019637632 00000100:00100000:0.0:1788850939.590196:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019637632 00000100:00100000:0.0:1788850939.590222:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788850939.590227:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019637632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788850939.590551:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019637632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.590557:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788850939.590664:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019637632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850939.590693:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019637760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788850939.590732:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850939.590751:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c093c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.590819:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019637760 00000100:00100000:0.0:1788850939.590823:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019637760 00000100:00100000:0.0:1788850939.590847:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788850939.590854:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019637760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788850939.590998:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019637760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.591004:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788850939.591159:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019637760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788850939.593127:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8479:1875746019637888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850939.593198:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850939.593269:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.593305:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019637888 00000100:00100000:0.0:1788850939.593313:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019637888 00000100:00100000:0.0:1788850939.593511:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788850939.593521:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:8479:x1875746019637888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788850939.593843:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:8479:x1875746019637888:12345-0@lo:502:llog_process_th.0 Request processed in 324us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.593852:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788850939.594090:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8479:1875746019637888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850939.594146:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8479:1875746019638016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850939.594186:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850939.594255:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.594293:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638016 00000100:00100000:0.0:1788850939.594298:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638016 00000100:00100000:0.0:1788850939.594336:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788850939.594342:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:8479:x1875746019638016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788850939.594661:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:8479:x1875746019638016:12345-0@lo:502:llog_process_th.0 Request processed in 317us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.594667:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788850939.594753:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8479:1875746019638016:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788850939.594777:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788850939.595100:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788850939.595122:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788850939.595131:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b9c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850939.595145:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b9c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788850939.595154:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788850939.595157:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788850939.595160:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788850939.595185:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850939.595192:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850939.595201:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850939.595218:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019638144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788850939.595251:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850939.595283:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b82a8ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788850939.595328:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638144 00000100:00100000:1.0:1788850939.595333:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638144 00000100:00100000:1.0:1788850939.595367:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788850939.595375:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019638144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788850939.595384:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850939.596113:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b8168e000/0x7ad3e1a879576baa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576ba3 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.596142:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b8168e000/0x7ad3e1a879576baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576ba3 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.596153:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b8168e000/0x7ad3e1a879576baa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576ba3 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.596162:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168e000, rc 0) 00000100:00100000:1.0:1788850939.596217:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019638144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 842us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850939.596237:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788850939.596353:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019638144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788850939.596369:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576baa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850939.596379:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576baa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850939.596509:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019638272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850939.596542:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850939.596573:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.596643:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638272 00000100:00100000:0.0:1788850939.596649:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638272 00000100:00100000:0.0:1788850939.596675:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788850939.596682:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019638272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788850939.597117:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019638272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 434us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.597124:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788850939.597326:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019638272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850939.597359:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019638400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850939.597506:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850939.597536:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.597588:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638400 00000100:00100000:0.0:1788850939.597594:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638400 00000100:00100000:0.0:1788850939.597626:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788850939.597634:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019638400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788850939.597840:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019638400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.597847:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788850939.598088:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019638400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788850939.598754:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d74e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8480:1875746019638528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850939.599031:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850939.599099:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.599131:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638528 00000100:00100000:0.0:1788850939.599136:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638528 00000100:00100000:0.0:1788850939.599201:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788850939.599210:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:8480:x1875746019638528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788850939.599504:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:8480:x1875746019638528:12345-0@lo:502:llog_process_th.0 Request processed in 295us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850939.599512:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788850939.599587:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d74e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8480:1875746019638528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788850939.599617:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850939.599625:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850939.599628:0:8480:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788850939.599634:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788850939.599657:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8480:1875746019638656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850939.599690:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850939.599975:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788850939.600099:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638656 00000100:00100000:1.0:1788850939.600104:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638656 00000100:00100000:1.0:1788850939.600130:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788850939.600137:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:8480:x1875746019638656:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850939.600307:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:8480:x1875746019638656:12345-0@lo:502:llog_process_th.0 Request processed in 170us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850939.600315:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788850939.600515:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8480:1875746019638656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788850939.600540:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850939.600551:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850939.600553:0:8480:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788850939.600558:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788850939.600715:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788850939.600735:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788850939.600744:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576baa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.600755:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576baa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850939.600765:0:5858:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788850939.600768:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a9b90470000 from 1 10000000:01000000:1.0:1788850939.600771:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788850939.600827:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.600835:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.600853:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576bb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850939.600869:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019638784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788850939.600913:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850939.601023:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638784 00000100:00100000:2.0:1788850939.601028:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638784 00000100:00100000:2.0:1788850939.601046:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788850939.601051:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019638784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788850939.601060:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850939.601071:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a3000/0x7ad3e1a879576bb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576bb1 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850939.601094:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a3000/0x7ad3e1a879576bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576bb1 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850939.601104:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a3000/0x7ad3e1a879576bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576bb1 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850939.601113:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a3000, rc 0) 00000100:00100000:2.0:1788850939.601135:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019638784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850939.601141:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788850939.602146:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788850939.602175:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019638784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788850939.602194:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576bb8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.602206:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576bb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576bb8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850939.602269:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019638912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788850939.602314:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850939.602604:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788850939.602949:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019638912 00000100:00100000:0.0:1788850939.602956:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019638912 00000100:00100000:2.0:1788850939.603030:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788850939.603043:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019638912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850939.603341:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019638912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (1026us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788850939.603350:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788850939.603778:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d75880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019638912:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788850939.603821:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788850939.603830:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576bb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576bb8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850939.603840:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576bb8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850939.667184:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850940.690360:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850941.715422:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850942.738074:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850942.994175:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019639040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788850942.994265:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850942.994875:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019639296:0@lo:400:kworker.0 00000100:00100000:0.0:1788850942.994957:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850942.994964:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019639040 00000100:00100000:1.0:1788850942.994981:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019639040 00000100:00100000:0.0:1788850942.994981:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788850942.994989:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019639424:0@lo:400:kworker.0 00000100:00100000:0.0:1788850942.995011:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850942.995056:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788850942.995068:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019639040:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788850942.995100:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019639296 00002000:00000024:1.0:1788850942.995103:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788850942.995106:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019639296 00000100:00100000:2.0:1788850942.995143:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019639424 00000100:00100000:2.0:1788850942.995147:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019639424 00000100:00100000:1.0:1788850942.995155:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019639040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850942.995172:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788850942.995180:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019639296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850942.995215:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788850942.995224:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019639296:12345-0@lo:400:kworker.0 Request processed in 44us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.995229:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019639424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850942.995238:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788850942.995263:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788850942.995269:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788850942.995274:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019639424:12345-0@lo:400:kworker.0 Request processed in 49us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.995281:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788850942.995285:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019639168:0@lo:400:kworker.0 00000100:00100000:3.0:1788850942.995311:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019639552:0@lo:400:kworker.0 00000100:00100000:2.0:1788850942.995321:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850942.995348:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850942.995353:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019639680:0@lo:400:kworker.0 00010000:00080000:3.0:1788850942.995388:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc18c0e00 x1875746019639040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850942.995400:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850942.995411:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019639040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788850942.995432:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019639680 00000100:00100000:2.0:1788850942.995437:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019639680 00000100:00100000:3.0:1788850942.995446:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019639552 00000100:00100000:3.0:1788850942.995452:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019639552 00000100:00100000:2.0:1788850942.995483:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788850942.995496:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788850942.995496:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019639680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850942.995509:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019639552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850942.995540:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019639680:12345-0@lo:400:kworker.0 Request processed in 49us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850942.995548:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788850942.995560:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019639552:12345-0@lo:400:kworker.0 Request processed in 54us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850942.995566:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788850942.995568:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788850942.995572:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788850942.995593:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019639680:0@lo:400:kworker.0 00010000:00080000:3.0:1788850942.995603:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc18c2680 x1875746019639552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850942.995614:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019639552:0@lo:400:kworker.0 00000100:00100000:2.0:1788850942.995615:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019639168 00000100:00100000:2.0:1788850942.995620:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019639168 00000100:00100000:2.0:1788850942.995646:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788850942.995661:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019639168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850942.995674:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019639424:0@lo:400:kworker.0 00000100:00100000:3.0:1788850942.995694:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019639296:0@lo:400:kworker.0 00000100:00100000:2.0:1788850942.997066:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019639168:12345-0@lo:400:kworker.0 Request processed in 1402us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850942.997077:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788850942.998025:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019639168:0@lo:400:kworker.0 00000100:00100000:1.0:1788850943.008951:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788850943.488827:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850943.488927:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850943.488970:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850943.489013:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850943.489050:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737408 00000100:00100000:1.0:1788850943.489060:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737408 00000100:00100000:2.0:1788850943.489408:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737024 00000100:00100000:2.0:1788850943.489413:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737024 00000100:00100000:2.0:1788850943.489462:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 165 00000100:00100000:2.0:1788850943.489472:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+8:2353:x1875746000737024:12345-192.168.204.6@tcp:400: 00000100:00100000:2.0:1788850943.489543:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+8:2353:x1875746000737024:12345-192.168.204.6@tcp:400: Request processed in 73us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850943.489550:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 165 00000100:00080000:2.0:1788850943.489685:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788850943.489941:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737280 00000100:00100000:1.0:1788850943.489947:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737280 00000100:00100000:1.0:1788850943.489980:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:1.0:1788850943.489989:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000737408:12345-192.168.204.6@tcp:400: 00000100:00100000:1.0:1788850943.490028:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000737408:12345-192.168.204.6@tcp:400: Request processed in 41us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850943.490035:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:1.0:1788850943.490050:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:1.0:1788850943.490057:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000737280:12345-192.168.204.6@tcp:400: 00000100:00100000:1.0:1788850943.490083:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000737280:12345-192.168.204.6@tcp:400: Request processed in 27us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850943.490089:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00080000:2.0:1788850943.490407:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788850943.490687:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737152 00000100:00100000:3.0:1788850943.490693:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737152 00000100:00100000:3.0:1788850943.490801:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:3.0:1788850943.490821:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000737152:12345-192.168.204.6@tcp:400: 00000100:00100000:3.0:1788850943.490958:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000737152:12345-192.168.204.6@tcp:400: Request processed in 149us (2178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850943.490966:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00080000:2.0:1788850943.494309:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788850943.506239:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019639808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788850943.506326:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850943.506541:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019639808 00000100:00100000:0.0:1788850943.506550:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019639808 00000100:00100000:0.0:1788850943.506605:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788850943.506615:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019639808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788850943.506678:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788850943.506735:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf042d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019639808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850943.506743:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788850943.506983:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc18c0700 x1875746019639808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850959 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850943.507003:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019639808:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788850943.762064:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850944.515053:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850944.515167:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737536 00000100:00100000:3.0:1788850944.515178:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737536 00000100:00100000:3.0:1788850944.515250:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 166 00000100:00100000:3.0:1788850944.515262:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+8:5606:x1875746000737536:12345-192.168.204.6@tcp:101: 00010000:00010000:3.0:1788850944.515288:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850944.515310:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a5800/0x7ad3e1a879576bbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfe9e2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850944.515359:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a5800/0x7ad3e1a879576bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9e2 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850944.515392:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a5800/0x7ad3e1a879576bbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9e2 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850944.515402:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a5800, rc 0) 00000100:00100000:3.0:1788850944.515461:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+9:5606:x1875746000737536:12345-192.168.204.6@tcp:101: Request processed in 202us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850944.515468:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 166 00000100:00100000:1.0:1788850944.519261:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850944.519423:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737664 00000100:00100000:2.0:1788850944.519441:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737664 00000100:00100000:2.0:1788850944.519514:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 167 00000100:00100000:2.0:1788850944.519526:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+9:5606:x1875746000737664:12345-192.168.204.6@tcp:501: 00000100:00100000:2.0:1788850944.519914:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+9:5606:x1875746000737664:12345-192.168.204.6@tcp:501: Request processed in 389us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850944.519923:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 167 00000100:00100000:1.0:1788850944.522528:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850944.522747:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737792 00000100:00100000:2.0:1788850944.522759:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737792 00000100:00100000:2.0:1788850944.522851:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 168 00000100:00100000:2.0:1788850944.522862:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+9:5606:x1875746000737792:12345-192.168.204.6@tcp:503: 00000100:00100000:2.0:1788850944.523116:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+9:5606:x1875746000737792:12345-192.168.204.6@tcp:503: Request processed in 256us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850944.523124:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 168 00000100:00100000:1.0:1788850944.530748:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850944.531048:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000737920 00000100:00100000:3.0:1788850944.531060:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000737920 00000100:00100000:3.0:1788850944.531115:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 169 00000100:00100000:3.0:1788850944.531125:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+9:6108:x1875746000737920:12345-192.168.204.6@tcp:502: 00000100:00100000:3.0:1788850944.531650:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+9:6108:x1875746000737920:12345-192.168.204.6@tcp:502: Request processed in 524us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850944.531659:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 169 00000100:00100000:1.0:1788850944.539110:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850944.542142:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738048 00000100:00100000:3.0:1788850944.542165:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738048 00000100:00100000:3.0:1788850944.542480:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 170 00000100:00100000:3.0:1788850944.542495:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+9:6108:x1875746000738048:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788850944.542941:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+9:6108:x1875746000738048:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 448us (3846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850944.542949:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 170 00000100:00100000:1.0:1788850944.550104:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850944.550481:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738176 00000100:00100000:2.0:1788850944.550495:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738176 00000100:00100000:2.0:1788850944.550567:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 171 00000100:00100000:2.0:1788850944.550578:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+9:5606:x1875746000738176:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788850944.550601:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788850944.550626:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a2400/0x7ad3e1a879576bc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfe9e9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850944.550667:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a2400/0x7ad3e1a879576bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9e9 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850944.550679:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a2400/0x7ad3e1a879576bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9e9 expref: 10 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850944.550690:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a2400, rc 0) 00000100:00100000:2.0:1788850944.550774:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:5606:x1875746000738176:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 197us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850944.550816:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 171 00000100:00100000:1.0:1788850944.577834:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850944.578283:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738304 00000100:00100000:3.0:1788850944.578300:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738304 00000100:00100000:3.0:1788850944.578375:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 172 00000100:00100000:3.0:1788850944.578387:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:5606:x1875746000738304:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850944.578752:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:5606:x1875746000738304:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 367us (981us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788850944.578761:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 172 00010000:00010000:0.0:1788850944.786107:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788850945.452508:0:8520:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd811ef0e0 20000000:00000080:0.0:1788850945.452527:0:8520:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a9baefb9800 uarg=0000000000000000 20000000:01000000:0.0:1788850945.452566:0:8520:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788850945.452573:0:8520:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788850945.452578:0:8520:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788850945.454256:0:8521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788850945.454435:0:8520:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788850945.459231:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788850945.459284:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788850945.459332:0:8520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788850945.459349:0:8520:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788850945.459369:0:8520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9b98af7000/0x7ad3e1a879576bcd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850945.459387:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576942 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a87957693b expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850945.459395:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a8795769a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a87957699d expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850945.459401:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576a6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576a68 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850945.459410:0:8520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b98af6600/0x7ad3e1a879576b2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9b1 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850945.459431:0:8520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9b98af7000/0x7ad3e1a879576bcd lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850945.459471:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b98af6600/0x7ad3e1a879576b2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9b1 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850945.459487:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9b98af6600/0x7ad3e1a879576b2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9b1 expref: 9 pid: 5855 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850945.459502:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1875746019639936:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788850945.459626:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576a6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576a68 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850945.459634:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576a6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576a68 expref: 18 pid: 5855 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850945.459642:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1875746019640064:0@lo:104: 00000100:00100000:0.0:1788850945.459681:0:8520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788850945.459711:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a8795769a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a87957699d expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850945.459720:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a8795769a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a87957699d expref: 18 pid: 5853 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850945.459728:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1875746019640192:0@lo:104: 00000100:00100000:0.0:1788850945.459753:0:8520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788850945.459810:0:8520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a87957693b expref: 18 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850945.459829:0:8520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576942 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a87957693b expref: 18 pid: 5856 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850945.459838:0:8520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1875746019640320:0@lo:104: 00000100:00100000:0.0:1788850945.459862:0:8520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788850945.459947:0:5845:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788850945.459966:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850945.459976:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640064 00000100:00100000:2.0:1788850945.459983:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640064 00000100:00100000:2.0:1788850945.460017:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640192 00000100:00100000:2.0:1788850945.460020:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640192 00000100:00100000:2.0:1788850945.460030:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640320 00000100:00100000:2.0:1788850945.460038:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640320 00000100:00100000:2.0:1788850945.460057:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788850945.460066:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+5:8520:x1875746019640064:12345-0@lo:104: 00010000:00010000:2.0:1788850945.460080:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f000/0x7ad3e1a879576a68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576a6f expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460146:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788850945.460153:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+5:8520:x1875746019640064:12345-0@lo:104: Request processed in 89us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850945.460160:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788850945.460179:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788850945.460184:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+4:8520:x1875746019640192:12345-0@lo:104: 00010000:00010000:2.0:1788850945.460192:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a87957699d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a8795769a4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460223:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788850945.460227:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+4:8520:x1875746019640192:12345-0@lo:104: Request processed in 44us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850945.460233:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788850945.460261:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788850945.460269:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+3:8520:x1875746019640320:12345-0@lo:104: 00010000:00010000:2.0:1788850945.460275:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7600/0x7ad3e1a87957693b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576942 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460308:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788850945.460313:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+3:8520:x1875746019640320:12345-0@lo:104: Request processed in 46us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850945.460319:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788850945.460341:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788850945.460347:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f000/0x7ad3e1a879576a68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576a6f expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460354:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f000 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:2.0:1788850945.460357:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f000/0x7ad3e1a879576a68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576a6f expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460365:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f000/0x7ad3e1a879576a68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576a6f expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788850945.460371:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f000/0x7ad3e1a879576a68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576a6f expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850945.460376:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788850945.460400:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f000/0x7ad3e1a879576a68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576a6f expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460406:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788850945.460429:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f000/0x7ad3e1a879576a68 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576a6f expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460436:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f000/0x7ad3e1a879576a68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576a6f expref: -99 pid: 7638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460449:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788850945.460451:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a87957699d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a8795769a4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460456:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4e00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:2.0:1788850945.460459:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a87957699d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a8795769a4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460472:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a87957699d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a8795769a4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788850945.460479:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a87957699d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a8795769a4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850945.460483:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788850945.460497:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a87957699d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795769a4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460502:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788850945.460517:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a87957699d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795769a4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460524:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a87957699d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a8795769a4 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460534:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788850945.460537:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7600/0x7ad3e1a87957693b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576942 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460542:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7600 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:2.0:1788850945.460545:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7600/0x7ad3e1a87957693b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576942 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460552:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7600/0x7ad3e1a87957693b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576942 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788850945.460558:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7600/0x7ad3e1a87957693b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576942 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788850945.460570:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788850945.460584:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7600/0x7ad3e1a87957693b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576942 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460590:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788850945.460596:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7600/0x7ad3e1a87957693b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576942 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460602:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7600/0x7ad3e1a87957693b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576942 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.460616:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850945.460618:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850945.460619:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850945.460626:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850945.461010:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850945.461037:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019640448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788850945.461080:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850945.461402:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640448 00000100:00100000:2.0:1788850945.461411:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640448 00010000:00010000:2.0:1788850945.461440:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576a6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576a68 expref: 19 pid: 5855 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850945.461478:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788850945.461485:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019640448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788850945.461497:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788850945.461502:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576a6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576a68 expref: 19 pid: 5855 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.461512:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576a6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576a68 expref: 19 pid: 5855 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.461541:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788850945.461578:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99172300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019640448:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850945.461585:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788850945.461700:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576a6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576a68 expref: 18 pid: 5855 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850945.461713:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1875746019640064:0@lo:104: 00000100:00100000:0.0:1788850945.461723:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1875746019640192:0@lo:104: 00000100:00100000:0.0:1788850945.461731:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1875746019640320:0@lo:104: 00000100:00100000:1.0:1788850945.461882:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019640448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788850945.462995:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019640576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788850945.463054:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850945.463096:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788850945.463104:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019640704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788850945.463125:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850945.463277:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640576 00000100:00100000:2.0:1788850945.463284:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640576 00010000:00010000:2.0:1788850945.463312:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a8795769a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a87957699d expref: 18 pid: 5853 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850945.463342:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640704 00000100:00100000:2.0:1788850945.463346:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640704 00010000:00010000:2.0:1788850945.463358:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576942 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a87957693b expref: 19 pid: 5856 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850945.463374:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788850945.463380:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019640576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788850945.463392:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788850945.463397:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a8795769a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a87957699d expref: 19 pid: 5853 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.463407:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a8795769a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a87957699d expref: 19 pid: 5853 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.463421:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a8795769a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a87957699d expref: 19 pid: 5853 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.463434:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788850945.463470:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:3310:x1875746019640576:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850945.463493:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788850945.463508:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788850945.463514:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:3310:x1875746019640704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788850945.463522:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788850945.463526:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576942 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a87957693b expref: 17 pid: 5856 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.463534:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576942 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a87957693b expref: 17 pid: 5856 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.463543:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576942 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a87957693b expref: 17 pid: 5856 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.463552:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788850945.463575:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+16:3310:x1875746019640704:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850945.463581:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788850945.463610:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019640704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788850945.463619:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019640576:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788850945.466470:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850945.466544:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738432 00000100:00100000:2.0:1788850945.466553:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738432 00010000:00010000:2.0:1788850945.466590:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b98af6600/0x7ad3e1a879576b2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9b1 expref: 10 pid: 5855 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850945.466628:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:2.0:1788850945.466637:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99173b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6835cbef-1345-4ac2-988d-7ad135109255+10:2353:x1875746000738432:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788850945.466664:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788850945.466670:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b98af6600/0x7ad3e1a879576b2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9b1 expref: 10 pid: 5855 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.466684:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b98af6600/0x7ad3e1a879576b2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9b1 expref: 10 pid: 5855 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.466704:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9b98af7000/0x7ad3e1a879576bcd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.466713:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af7000/0x7ad3e1a879576bcd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.466731:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b98af7000/0x7ad3e1a879576bcd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.466739:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b98af7000/0x7ad3e1a879576bcd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.466746:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9b98af7000/0x7ad3e1a879576bcd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.466753:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9b98af7000/0x7ad3e1a879576bcd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.466758:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7000 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788850945.466762:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9b98af7000/0x7ad3e1a879576bcd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.466818:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9b98af7000/0x7ad3e1a879576bcd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.466840:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9b98af7000/0x7ad3e1a879576bcd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.466851:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788850945.466912:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99173b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6835cbef-1345-4ac2-988d-7ad135109255+10:2353:x1875746000738432:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 275us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850945.466920:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 24 00010000:00010000:0.0:1788850945.467156:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af6600/0x7ad3e1a879576b2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9b1 expref: 9 pid: 5855 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850945.467171:0:8520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8520:1875746019639936:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788850945.467201:0:8520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9b98af7000/0x7ad3e1a879576bcd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850945.467210:0:8520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9b98af7000/0x7ad3e1a879576bcd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850945.467229:0:8520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9b98af7000/0x7ad3e1a879576bcd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850945.467235:0:8520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af7000/0x7ad3e1a879576bcd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850945.818537:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850945.955677:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850945.958244:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738560 00000100:00100000:3.0:1788850945.958272:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738560 00000100:00100000:3.0:1788850945.958352:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 173 00000100:00100000:3.0:1788850945.958363:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+9:5606:x1875746000738560:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788850945.958379:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850945.958400:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576bd4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfe9f0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850945.958436:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576bd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9f0 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850945.958448:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576bd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9f0 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850945.958458:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a5400, rc 0) 00000100:00100000:3.0:1788850945.958538:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+10:5606:x1875746000738560:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 176us (3003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850945.958553:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 173 00000100:00100000:3.0:1788850945.961673:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850945.962018:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738688 00000100:00100000:1.0:1788850945.962030:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738688 00000100:00100000:1.0:1788850945.962096:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 174 00000100:00100000:1.0:1788850945.962108:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:5606:x1875746000738688:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788850945.962820:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:5606:x1875746000738688:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 711us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850945.962829:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 174 00000100:00100000:3.0:1788850945.966135:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850945.966243:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738816 00000100:00100000:1.0:1788850945.966253:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738816 00000100:00100000:1.0:1788850945.966457:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 175 00000100:00100000:1.0:1788850945.966469:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:5606:x1875746000738816:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788850945.966741:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:5606:x1875746000738816:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 Request processed in 274us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850945.966749:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 175 00000100:00100000:1.0:1788850945.982623:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850945.982750:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000738944 00000100:00100000:3.0:1788850945.982777:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000738944 00000100:00100000:3.0:1788850945.982883:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 176 00000100:00100000:3.0:1788850945.982919:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+10:6160:x1875746000738944:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788850945.983253:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+10:6160:x1875746000738944:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 337us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850945.983263:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 176 00000100:00100000:3.0:1788850945.992132:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850945.992430:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739072 00000100:00100000:2.0:1788850945.992447:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739072 00000100:00100000:2.0:1788850945.992537:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 177 00000100:00100000:2.0:1788850945.992551:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:6160:x1875746000739072:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788850945.993356:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:6160:x1875746000739072:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 803us (1237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850945.993378:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 177 10000000:01000000:1.0:1788850946.642981:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788850946.642994:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9b866a7000 from 4 10000000:01000000:1.0:1788850946.643000:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788850946.643068:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f200/0x7ad3e1a879576bdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850946.643082:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f200/0x7ad3e1a879576bdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850946.643097:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f200/0x7ad3e1a879576bdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850946.643131:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019640832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788850946.643226:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850946.643288:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850946.643716:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640832 00000100:00100000:3.0:1788850946.643728:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640832 00000100:00100000:3.0:1788850946.646328:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788850946.646357:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019640832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788850946.646386:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788850946.646408:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576be2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576bdb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850946.646444:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576bdb expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850946.646457:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576bdb expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788850946.646467:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4c00, rc 0) 00000100:00100000:3.0:1788850946.646578:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019640832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (3352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850946.646586:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788850946.647372:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019640832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788850946.647400:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f200/0x7ad3e1a879576bdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576be2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850946.647413:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f200/0x7ad3e1a879576bdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576be2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850946.647518:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019640960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850946.647572:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850946.653546:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b91a05180 going to sleep for 11 seconds 00000100:00100000:1.0:1788850946.654003:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019640960 00000100:00100000:1.0:1788850946.654019:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019640960 00000100:00100000:1.0:1788850946.654096:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788850946.654108:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019640960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788850946.654551:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019640960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 443us (6977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850946.654560:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788850946.654911:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019640960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850946.654996:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019641088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850946.655056:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850946.655096:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b91a05180 going to sleep for 11 seconds 00000100:00100000:1.0:1788850946.655146:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641088 00000100:00100000:1.0:1788850946.655152:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641088 00000100:00100000:1.0:1788850946.655182:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788850946.655190:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019641088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788850946.655376:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019641088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850946.655383:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788850946.655471:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019641088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850946.656257:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8551:1875746019641216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850946.656316:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850946.656345:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b91a05d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788850946.656395:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641216 00000100:00100000:1.0:1788850946.656401:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641216 00000100:00100000:1.0:1788850946.656431:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788850946.656439:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:8551:x1875746019641216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850946.656985:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:8551:x1875746019641216:12345-0@lo:502:llog_process_th.0 Request processed in 544us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850946.656994:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788850946.657087:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8551:1875746019641216:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788850946.657121:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788850946.657134:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850946.657137:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788850946.657145:0:8551:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a9b866a7000 00000020:00000080:2.0:1788850946.657150:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788850946.657257:0:8551:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8551:1875746019641344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850946.657299:0:8551:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850946.657315:0:8551:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b91a05d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788850946.660892:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641344 00000100:00100000:3.0:1788850946.660915:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641344 00000100:00100000:2.0:1788850946.661834:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788850946.661848:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+17:8551:x1875746019641344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850946.662199:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+17:8551:x1875746019641344:12345-0@lo:502:llog_process_th.0 Request processed in 352us (4897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850946.662209:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788850946.662298:0:8551:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8551:1875746019641344:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788850946.662348:0:8551:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788850946.662359:0:8551:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788850946.662367:0:8551:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788850946.662374:0:8551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788850946.663890:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788850946.663936:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788850946.663952:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f200/0x7ad3e1a879576bdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576be2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850946.663967:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f200/0x7ad3e1a879576bdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576be2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850946.663981:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788850946.663984:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9ba049f800 from 4 10000000:01000000:1.0:1788850946.663987:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788850946.664036:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f800/0x7ad3e1a879576be9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850946.664046:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f800/0x7ad3e1a879576be9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850946.664058:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f800/0x7ad3e1a879576be9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850946.664088:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019641472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788850946.664169:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850946.664235:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788850946.664258:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641472 00000100:00100000:1.0:1788850946.664266:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641472 00000100:00100000:1.0:1788850946.668994:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788850946.669030:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019641472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788850946.669058:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850946.669088:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b8168e600/0x7ad3e1a879576bf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576be9 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850946.669129:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b8168e600/0x7ad3e1a879576bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576be9 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850946.669143:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b8168e600/0x7ad3e1a879576bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576be9 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850946.669154:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168e600, rc 0) 00000100:00100000:1.0:1788850946.669965:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019641472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 948us (5791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850946.669976:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788850946.679014:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019641472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788850946.679072:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f800/0x7ad3e1a879576be9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576bf0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850946.679090:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f800/0x7ad3e1a879576be9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576bf0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788850946.679192:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019641600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850946.679279:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850946.679349:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b95792b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788850946.679351:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641600 00000100:00100000:3.0:1788850946.679360:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641600 00000100:00100000:3.0:1788850946.679423:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788850946.680545:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019641600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850946.681223:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019641600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1776us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850946.681236:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788850946.693120:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019641600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788850946.693234:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019641728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850946.693341:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850946.693402:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641728 00000100:00100000:2.0:1788850946.693411:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641728 00000100:00100000:2.0:1788850946.693498:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788850946.693509:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019641728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788850946.693939:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019641728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 429us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850946.693950:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788850946.694039:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b95792b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788850946.694058:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019641728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788850946.700033:0:8555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf043480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8555:1875746019641856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850946.700172:0:8555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850946.700220:0:8555:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905fd180 going to sleep for 11 seconds 00000100:00100000:1.0:1788850946.700694:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641856 00000100:00100000:1.0:1788850946.700709:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641856 00000100:00100000:1.0:1788850946.700821:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788850946.700832:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:8555:x1875746019641856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850946.701634:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:8555:x1875746019641856:12345-0@lo:502:llog_process_th.0 Request processed in 798us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850946.701646:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788850946.708228:0:8555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf043480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8555:1875746019641856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788850946.711706:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788850946.711730:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788850946.711732:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788850946.711742:0:8555:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a9ba049f800 00000020:00000080:0.0:1788850946.711757:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788850946.711932:0:8555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8555:1875746019641984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788850946.712055:0:8555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850946.712125:0:8555:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf44840 going to sleep for 11 seconds 00000100:00100000:3.0:1788850946.713042:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019641984 00000100:00100000:3.0:1788850946.713059:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019641984 00000100:00100000:3.0:1788850946.713118:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788850946.713128:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:8555:x1875746019641984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788850946.713706:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:8555:x1875746019641984:12345-0@lo:502:llog_process_th.0 Request processed in 576us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850946.713718:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788850946.714981:0:8555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8555:1875746019641984:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788850946.715044:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850946.715063:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850946.715066:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788850946.715072:0:8555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788850946.715163:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788850946.715187:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788850946.715201:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f800/0x7ad3e1a879576be9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576bf0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850946.715215:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f800/0x7ad3e1a879576be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576bf0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788850946.715229:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788850946.715233:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9ba0462000 from 4 10000000:01000000:1.0:1788850946.715236:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788850946.715287:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ee00/0x7ad3e1a879576bf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850946.715296:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ee00/0x7ad3e1a879576bf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850946.715308:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ee00/0x7ad3e1a879576bf7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788850946.715337:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019642112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788850946.715421:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850946.715915:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019642112 00000100:00100000:1.0:1788850946.715925:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019642112 00000100:00100000:1.0:1788850946.716025:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788850946.716037:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019642112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788850946.716055:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850946.716081:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b8168f000/0x7ad3e1a879576bfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576bf7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850946.716114:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b8168f000/0x7ad3e1a879576bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576bf7 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850946.716127:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b8168f000/0x7ad3e1a879576bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576bf7 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850946.716136:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f000, rc 0) 00000100:00100000:1.0:1788850946.716183:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019642112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850946.716190:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788850946.718022:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788850946.718079:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019642112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788850946.718109:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ee00/0x7ad3e1a879576bf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576bfe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850946.718123:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ee00/0x7ad3e1a879576bf7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576bfe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788850946.718234:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019642240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788850946.718313:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850946.726607:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf440c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788850946.734028:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019642240 00000100:00100000:3.0:1788850946.734055:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019642240 00000100:00100000:3.0:1788850946.734143:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788850946.734155:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019642240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850946.734594:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019642240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 440us (16278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850946.734603:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788850946.734710:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019642240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788850946.734823:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf043480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019642368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788850946.734888:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850946.734924:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98a21d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788850946.734939:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019642368 00000100:00100000:3.0:1788850946.734943:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019642368 00000100:00100000:3.0:1788850946.734964:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788850946.734970:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019642368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788850946.735143:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019642368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850946.735151:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788850946.735193:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf043480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019642368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788850946.758111:0:8559:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8559:1875746019642496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850946.758247:0:8559:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850946.758302:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019642496 00000100:00100000:1.0:1788850946.758312:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019642496 00000100:00100000:1.0:1788850946.758366:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788850946.758377:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:8559:x1875746019642496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850946.758657:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:8559:x1875746019642496:12345-0@lo:502:llog_process_th.0 Request processed in 280us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850946.758667:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788850946.758754:0:8559:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788850946.758812:0:8559:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8559:1875746019642496:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788850946.758851:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788850946.758863:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850946.758866:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788850946.758874:0:8559:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a9ba0462000 00000020:00000080:1.0:1788850946.758882:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788850946.758987:0:8559:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8559:1875746019642624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788850946.759025:0:8559:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850946.759040:0:8559:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788850946.759628:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019642624 00000100:00100000:2.0:1788850946.759640:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019642624 00000100:00100000:2.0:1788850946.759701:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788850946.759711:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:8559:x1875746019642624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788850946.759957:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:8559:x1875746019642624:12345-0@lo:502:llog_process_th.0 Request processed in 248us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850946.759965:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788850946.763712:0:8559:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:8559:1875746019642624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788850946.763810:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788850946.763825:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788850946.763828:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788850946.763834:0:8559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788850946.763930:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788850946.763962:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788850946.763977:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ee00/0x7ad3e1a879576bf7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576bfe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850946.763993:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ee00/0x7ad3e1a879576bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576bfe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788850946.841858:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850947.858462:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850948.114105:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019643136:0@lo:400:kworker.0 00000100:00100000:0.0:1788850948.114185:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.114238:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019643008:0@lo:400:kworker.0 00000100:00100000:2.0:1788850948.114271:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.114327:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643008 00000100:00100000:2.0:1788850948.114334:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643008 00000100:00100000:1.0:1788850948.114346:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019642880:0@lo:400:kworker.0 00000100:00100000:1.0:1788850948.114376:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788850948.114419:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788850948.114443:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643136 00000100:00100000:0.0:1788850948.114447:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643136 00000100:00100000:0.0:1788850948.114482:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788850948.114492:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019643136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850948.114539:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019643136:12345-0@lo:400:kworker.0 Request processed in 50us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.114546:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788850948.114563:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788850948.114586:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc18c1c00 x1875746019643136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850948.114601:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019643136:0@lo:400:kworker.0 00000100:00100000:1.0:1788850948.114812:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019643392:0@lo:400:kworker.0 00000100:00100000:1.0:1788850948.114851:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850948.114878:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788850948.114960:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019642752:0@lo:400:kworker.0 00000100:00100000:1.0:1788850948.114992:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850948.115014:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019643264:0@lo:400:kworker.0 00000100:00100000:1.0:1788850948.115036:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.116970:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019642880 00000100:00100000:2.0:1788850948.116983:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019642880 00000100:00100000:2.0:1788850948.117052:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788850948.117063:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019643008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850948.117149:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019643008:12345-0@lo:400:kworker.0 Request processed in 88us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.117155:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788850948.117633:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643264 00000100:00100000:2.0:1788850948.117638:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643264 00000100:00100000:2.0:1788850948.117669:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788850948.117669:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643392 00000100:00100000:2.0:1788850948.117675:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019642880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850948.117686:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643392 00000100:00100000:2.0:1788850948.117728:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019642880:12345-0@lo:400:kworker.0 Request processed in 42us (3340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.117734:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788850948.117744:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788850948.117746:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788850948.117751:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019643264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850948.117751:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019643392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850948.117805:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019643264:12345-0@lo:400:kworker.0 Request processed in 52us (2767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850948.117805:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019643392:12345-0@lo:400:kworker.0 Request processed in 54us (2952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.117812:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788850948.117812:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788850948.117831:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019642752 00000100:00100000:1.0:1788850948.117834:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019642752 00000100:00100000:2.0:1788850948.117853:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019643008:0@lo:400:kworker.0 00000100:00100000:1.0:1788850948.117857:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788850948.117862:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019642752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850948.117966:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019642752:12345-0@lo:400:kworker.0 Request processed in 103us (2973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850948.117973:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788850948.118011:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019642752:0@lo:400:kworker.0 00000100:00100000:1.0:1788850948.118021:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019643264:0@lo:400:kworker.0 00000100:00100000:1.0:1788850948.118031:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019642880:0@lo:400:kworker.0 00010000:00080000:1.0:1788850948.118041:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc18c0000 x1875746019643392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850948.118051:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019643392:0@lo:400:kworker.0 00000100:00100000:1.0:1788850948.118127:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788850948.118137:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019643520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788850948.118167:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850948.118195:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643520 00000100:00100000:1.0:1788850948.118199:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643520 00000100:00100000:1.0:1788850948.118225:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788850948.118240:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019643520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788850948.118269:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850948.118316:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019643520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850948.118322:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788850948.118349:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bafea9f80 x1875746019643520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850948.118363:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019643520:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788850948.118388:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788850948.118393:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788850948.612457:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850948.614942:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739200 00000100:00100000:3.0:1788850948.614958:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739200 00000100:00100000:3.0:1788850948.615023:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 194 00000100:00100000:3.0:1788850948.615034:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:2353:x1875746000739200:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788850948.615445:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:2353:x1875746000739200:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 411us (2995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850948.615455:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 194 00000100:00100000:3.0:1788850948.617671:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850948.617726:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850948.617861:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739328 00000100:00100000:2.0:1788850948.617871:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739328 00000100:00100000:2.0:1788850948.617942:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:2.0:1788850948.617952:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000739328:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788850948.618041:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000739328:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 90us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.618065:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:0.0:1788850948.618378:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739456 00000100:00100000:0.0:1788850948.618383:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739456 00000100:00100000:0.0:1788850948.618428:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:0.0:1788850948.618437:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000739456:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788850948.618472:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000739456:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 36us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850948.618479:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00080000:3.0:1788850948.618678:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788850948.618683:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788850948.618821:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850948.618885:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739584 00000100:00100000:2.0:1788850948.618889:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739584 00000100:00100000:2.0:1788850948.618932:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:2.0:1788850948.618940:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2354:x1875746000739584:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788850948.618972:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2354:x1875746000739584:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 33us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.618979:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00080000:0.0:1788850948.619066:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788850948.626072:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019643648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788850948.626149:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850948.626426:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643648 00000100:00100000:2.0:1788850948.626435:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643648 00000100:00100000:2.0:1788850948.626487:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788850948.626498:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019643648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788850948.626534:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788850948.630842:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019643648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4334us (4681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850948.630886:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788850948.634956:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc18c2d80 x1875746019643648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850964 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850948.634990:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019643648:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788850948.881959:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850949.906005:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850950.931544:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788850951.916715:0:8819:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788850951.955084:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850952.978573:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850953.234140:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019644032:0@lo:400:kworker.0 00000100:00100000:0.0:1788850953.234366:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850953.234442:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788850953.234450:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019644160:0@lo:400:kworker.0 00000100:00100000:0.0:1788850953.234502:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850953.234538:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644032 00000100:00100000:0.0:1788850953.234547:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644032 00000100:00100000:0.0:1788850953.234616:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788850953.234643:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019644032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850953.234705:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019644032:12345-0@lo:400:kworker.0 Request processed in 67us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850953.234712:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788850953.234739:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644160 00000100:00100000:0.0:1788850953.234743:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644160 00000100:00100000:0.0:1788850953.234773:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788850953.234811:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019644160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850953.234983:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019643904:0@lo:400:kworker.0 00000100:00100000:2.0:1788850953.235018:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850953.235041:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019644416:0@lo:400:kworker.0 00000100:00100000:2.0:1788850953.235062:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850953.235108:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788850953.235114:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019643776:0@lo:400:kworker.0 00000100:00100000:2.0:1788850953.235143:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850953.235164:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019644288:0@lo:400:kworker.0 00000100:00100000:2.0:1788850953.235185:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850953.235493:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643904 00000100:00100000:2.0:1788850953.235498:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643904 00000100:00100000:2.0:1788850953.235530:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644288 00000100:00100000:2.0:1788850953.235534:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644288 00000100:00100000:2.0:1788850953.235551:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788850953.235558:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019643904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850953.235602:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019643904:12345-0@lo:400:kworker.0 Request processed in 44us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850953.235608:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788850953.235635:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788850953.235642:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019644288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850953.235671:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019644288:12345-0@lo:400:kworker.0 Request processed in 30us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850953.235693:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788850953.235716:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644416 00000100:00100000:2.0:1788850953.235720:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644416 00000100:00100000:2.0:1788850953.235748:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788850953.235755:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019644416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850953.235815:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019644416:12345-0@lo:400:kworker.0 Request processed in 61us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850953.235821:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788850953.235992:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019643776 00000100:00100000:1.0:1788850953.235997:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019643776 00000100:00100000:1.0:1788850953.236031:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788850953.236039:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019643776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850953.237987:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019644288:0@lo:400:kworker.0 00000100:00100000:2.0:1788850953.238014:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019643904:0@lo:400:kworker.0 00010000:00080000:2.0:1788850953.238034:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc18c0700 x1875746019644416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850953.238046:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019644416:0@lo:400:kworker.0 00000100:00100000:0.0:1788850953.240439:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019644160:12345-0@lo:400:kworker.0 Request processed in 5648us (5924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850953.240456:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788850953.240505:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788850953.240512:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788850953.240516:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788850953.240574:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc18c3480 x1875746019644160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850953.240589:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019644160:0@lo:400:kworker.0 00000100:00100000:0.0:1788850953.240606:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019644032:0@lo:400:kworker.0 00000100:00100000:0.0:1788850953.240744:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788850953.240758:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019644544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788850953.242091:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850953.242159:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644544 00000100:00100000:0.0:1788850953.242179:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644544 00000100:00100000:0.0:1788850953.242248:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788850953.242259:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019644544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788850953.242316:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850953.243778:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019643776:12345-0@lo:400:kworker.0 Request processed in 7732us (8626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850953.243807:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788850953.246966:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019644544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4694us (4864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850953.246986:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788850953.247099:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019643776:0@lo:400:kworker.0 00010000:00080000:3.0:1788850953.247706:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b87d77b80 x1875746019644544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850953.247737:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019644544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788850953.732810:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850953.732859:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850953.732908:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850953.732940:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850953.732977:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739840 00000100:00100000:0.0:1788850953.732991:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739840 00000100:00100000:1.0:1788850953.733108:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739712 00000100:00100000:1.0:1788850953.733113:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739712 00000100:00100000:1.0:1788850953.733148:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 196 00000100:00100000:1.0:1788850953.733160:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+10:2353:x1875746000739712:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788850953.733252:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+10:2353:x1875746000739712:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 94us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850953.733260:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 196 00000100:00100000:0.0:1788850953.734901:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:0.0:1788850953.734944:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000739840:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788850953.735031:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000739840:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 104us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850953.735040:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:0.0:1788850953.735107:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000739968 00000100:00100000:0.0:1788850953.735117:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000739968 00000100:00100000:0.0:1788850953.735165:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740096 00000100:00100000:0.0:1788850953.735168:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740096 00000100:00100000:0.0:1788850953.735195:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:0.0:1788850953.735200:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2350:x1875746000739968:12345-192.168.204.6@tcp:9:kworker.0 00000020:00000080:0.0:1788850953.735235:0:6707:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576b3a 00000100:00080000:0.0:1788850953.735248:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8a9ba05c7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788850953.735309:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:1.0:1788850953.735340:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788850953.735345:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788850953.735354:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788850953.735369:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:1.0:1788850953.735377:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2350:x1875746000740096:12345-192.168.204.6@tcp:9:kworker.0 00000020:00000080:1.0:1788850953.735398:0:8281:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576b41 00000100:00080000:1.0:1788850953.735404:0:8281:0:(import.c:65:import_set_state_nolock()) ffff8a9b84e5f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788850953.735433:0:8281:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788850953.735717:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+2:2350:x1875746000740096:12345-192.168.204.6@tcp:9:kworker.0 Request processed in 339us (2774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850953.735724:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:0.0:1788850953.736211:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+2:2350:x1875746000739968:12345-192.168.204.6@tcp:9:kworker.0 Request processed in 1009us (3301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850953.736219:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 10 00010000:00010000:3.0:1788850953.736645:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850953.736810:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850953.746033:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788850953.746067:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019644672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788850953.746166:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850953.746373:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644672 00000100:00100000:1.0:1788850953.746385:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644672 00000100:00100000:1.0:1788850953.746681:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788850953.746694:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019644672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788850953.746745:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850953.746834:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019644672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850953.746841:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1788850953.746894:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b8bcf0700 x1875746019644672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850969 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850953.746921:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019644672:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788850954.004477:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850955.026101:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850956.051417:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850957.075769:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788850957.911256:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c328062-9d4c-41e6-ae57-f4af3bf37898 00000020:00000080:3.0:1788850957.911266:0:6732:0:(genops.c:885:class_export_put()) final put ffff8a9ba05c1000/3c328062-9d4c-41e6-ae57-f4af3bf37898 00000020:00000080:0.0:1788850957.911581:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9ba05c1000/3c328062-9d4c-41e6-ae57-f4af3bf37898 for lustre-OST0000 00000020:00000080:0.0:1788850957.911637:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9ba05c7000 for lustre-OST0000 00000001:00100000:3.0:1788850957.914491:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c328062-9d4c-41e6-ae57-f4af3bf37898 00000020:00000080:3.0:1788850957.915294:0:7656:0:(genops.c:885:class_export_put()) final put ffff8a9ba05c3800/3c328062-9d4c-41e6-ae57-f4af3bf37898 00000020:00000080:2.0:1788850957.915373:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9ba05c3800/3c328062-9d4c-41e6-ae57-f4af3bf37898 for lustre-OST0001 00000020:00000080:2.0:1788850957.915421:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9b84e5f800 for lustre-OST0001 00010000:00010000:0.0:1788850958.103236:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788850958.280772:0:9067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing yml_node 00000100:00100000:2.0:1788850958.354547:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788850958.354576:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019644800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788850958.354646:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850958.354758:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644800 00000100:00100000:1.0:1788850958.354768:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644800 00000100:00100000:1.0:1788850958.354863:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788850958.354874:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019644800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788850958.354910:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850958.354956:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019644800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850958.354965:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788850958.354988:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788850958.355137:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bafea9f80 x1875746019644800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850958.355155:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019644800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788850958.355917:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019645056:0@lo:400:kworker.0 00000100:00100000:2.0:1788850958.355962:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850958.355990:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788850958.355997:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019645184:0@lo:400:kworker.0 00000100:00100000:2.0:1788850958.356020:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850958.356054:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645056 00000100:00100000:2.0:1788850958.356059:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645056 00000100:00100000:2.0:1788850958.356093:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645184 00000100:00100000:2.0:1788850958.356096:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645184 00000100:00100000:2.0:1788850958.356125:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788850958.356132:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019645056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850958.356171:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019645056:12345-0@lo:400:kworker.0 Request processed in 39us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850958.356177:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788850958.356191:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788850958.356197:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019645184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850958.356225:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019645184:12345-0@lo:400:kworker.0 Request processed in 29us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850958.356231:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788850958.356254:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788850958.356274:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019645184:0@lo:400:kworker.0 00000100:00100000:2.0:1788850958.356284:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019645056:0@lo:400:kworker.0 00000100:00100000:1.0:1788850958.356472:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019645312:0@lo:400:kworker.0 00000100:00100000:1.0:1788850958.356510:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850958.356550:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788850958.356557:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019644928:0@lo:400:kworker.0 00000100:00100000:1.0:1788850958.356583:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850958.356610:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875746019645440:0@lo:400:kworker.0 00000100:00100000:1.0:1788850958.356633:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850958.356658:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019644928 00000100:00100000:1.0:1788850958.356662:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019644928 00000100:00100000:1.0:1788850958.356691:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788850958.356699:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019644928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850958.356737:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019644928:12345-0@lo:400:kworker.0 Request processed in 39us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850958.356745:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788850958.356804:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019644928:0@lo:400:kworker.0 00000100:00100000:2.0:1788850958.356979:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645312 00000100:00100000:2.0:1788850958.356983:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645312 00000100:00100000:2.0:1788850958.357032:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788850958.357039:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafeab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019645312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850958.357083:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafeab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019645312:12345-0@lo:400:kworker.0 Request processed in 45us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850958.357089:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788850958.357104:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645440 00000100:00100000:2.0:1788850958.357107:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645440 00000100:00100000:2.0:1788850958.357131:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788850958.357138:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafeaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875746019645440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850958.357165:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafeaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875746019645440:12345-0@lo:400:kworker.0 Request processed in 28us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850958.357171:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788850958.357198:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875746019645440:0@lo:400:kworker.0 00010000:00080000:2.0:1788850958.357210:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf4d0700 x1875746019645312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850958.357220:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019645312:0@lo:400:kworker.0 00000100:00080000:3.0:1788850958.357268:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788850958.357272:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788850958.855244:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850958.855291:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850958.855353:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740224 00000100:00100000:3.0:1788850958.855363:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740224 00000100:00100000:3.0:1788850958.855418:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 198 00000100:00100000:3.0:1788850958.855429:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:2354:x1875746000740224:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788850958.855504:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:2354:x1875746000740224:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 77us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850958.855524:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 198 00000100:00100000:0.0:1788850958.856126:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740352 00000100:00100000:0.0:1788850958.856133:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740352 00000100:00080000:3.0:1788850958.856224:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788850958.857075:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:0.0:1788850958.857088:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000740352:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788850958.857154:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000740352:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 70us (1919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850958.857160:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:1.0:1788850958.866975:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788850958.867003:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019645568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788850958.867077:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850958.867234:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645568 00000100:00100000:3.0:1788850958.867242:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645568 00000100:00100000:3.0:1788850958.867293:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788850958.867303:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019645568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788850958.867339:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788850958.867392:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019645568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850958.867399:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788850958.867439:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf040e00 x1875746019645568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850958.867458:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019645568:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788850959.122031:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850960.146206:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788850961.172808:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850962.194067:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850963.218237:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850963.474117:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788850963.474139:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafeaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019645696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788850963.474206:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850963.474404:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645696 00000100:00100000:1.0:1788850963.474412:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645696 00000100:00100000:1.0:1788850963.474489:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788850963.474498:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019645696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788850963.474538:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850963.474590:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019645696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850963.474614:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788850963.474654:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bafeaa300 x1875746019645696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850963.474672:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafeaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019645696:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788850963.474806:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788850963.475820:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019645824:0@lo:400:kworker.0 00000100:00100000:2.0:1788850963.475879:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850963.475927:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875746019646336:0@lo:400:kworker.0 00000100:00100000:2.0:1788850963.475952:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850963.475974:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788850963.475987:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019645952:0@lo:400:kworker.0 00000100:00100000:2.0:1788850963.476030:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850963.476060:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646336 00000100:00100000:2.0:1788850963.476066:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646336 00000100:00100000:2.0:1788850963.476106:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645952 00000100:00100000:2.0:1788850963.476109:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645952 00000100:00100000:2.0:1788850963.476132:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788850963.476140:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875746019646336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850963.476181:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875746019646336:12345-0@lo:400:kworker.0 Request processed in 43us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850963.476188:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788850963.476202:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788850963.476208:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019645952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850963.476234:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019645952:12345-0@lo:400:kworker.0 Request processed in 27us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850963.476240:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788850963.476267:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019646208:0@lo:400:kworker.0 00000100:00100000:2.0:1788850963.476293:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850963.476310:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788850963.476317:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019646080:0@lo:400:kworker.0 00000100:00100000:2.0:1788850963.476336:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788850963.476355:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788850963.476363:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646080 00000100:00100000:2.0:1788850963.476366:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646080 00000100:00100000:2.0:1788850963.476390:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788850963.476396:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019646080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850963.476442:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019646080:12345-0@lo:400:kworker.0 Request processed in 46us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850963.476457:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788850963.476474:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788850963.476497:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf043b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019646080:0@lo:400:kworker.0 00000100:00100000:2.0:1788850963.476520:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019645952:0@lo:400:kworker.0 00000100:00100000:2.0:1788850963.476543:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875746019646336:0@lo:400:kworker.0 00000100:00100000:0.0:1788850963.476771:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019645824 00000100:00100000:0.0:1788850963.476776:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019645824 00000100:00100000:0.0:1788850963.476826:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788850963.476833:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019645824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850963.476867:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019645824:12345-0@lo:400:kworker.0 Request processed in 35us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850963.476882:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788850963.481198:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019645824:0@lo:400:kworker.0 00000100:00100000:1.0:1788850963.481878:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646208 00000100:00100000:1.0:1788850963.481888:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646208 00000100:00100000:1.0:1788850963.481963:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788850963.481986:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019646208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850963.482088:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019646208:12345-0@lo:400:kworker.0 Request processed in 117us (5793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850963.482096:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788850963.482136:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf040700 x1875746019646208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850963.482156:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019646208:0@lo:400:kworker.0 00000100:00080000:2.0:1788850963.482702:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788850963.714215:0:9260:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:2.0:1788850963.983488:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850963.983540:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850963.983843:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740608 00000100:00100000:2.0:1788850963.983853:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740608 00000100:00100000:2.0:1788850963.983915:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:2.0:1788850963.983927:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2352:x1875746000740608:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788850963.984019:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2352:x1875746000740608:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 94us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850963.984027:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00080000:2.0:1788850963.984049:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788850963.984236:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740480 00000100:00100000:0.0:1788850963.984242:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740480 00000100:00100000:0.0:1788850963.984273:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 200 00000100:00100000:0.0:1788850963.984279:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:2352:x1875746000740480:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788850963.984324:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:2352:x1875746000740480:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 44us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850963.984331:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 200 00000100:00100000:2.0:1788850963.988371:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788850963.988397:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019646464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788850963.988486:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850963.990208:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646464 00000100:00100000:1.0:1788850963.990225:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646464 00000100:00100000:1.0:1788850963.990292:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788850963.990304:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019646464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788850963.990346:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850963.990440:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019646464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850963.990448:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788850963.991749:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf4d0700 x1875746019646464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850963.991775:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019646464:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788850964.246998:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850965.266000:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850966.290114:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788850966.651378:0:9358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:2.0:1788850967.314243:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850968.338373:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850968.594460:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafeaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019646592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788850968.594569:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850968.598096:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646592 00000100:00100000:1.0:1788850968.598110:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646592 00000100:00100000:1.0:1788850968.598198:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788850968.598238:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019646592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788850968.598287:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850968.598388:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019646592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (3819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850968.598395:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788850968.598420:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788850968.598552:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019646720:0@lo:400:kworker.0 00000100:00100000:3.0:1788850968.598599:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850968.598643:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019647232:0@lo:400:kworker.0 00000100:00100000:3.0:1788850968.598665:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850968.598688:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788850968.598693:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019647104:0@lo:400:kworker.0 00000100:00100000:3.0:1788850968.598713:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850968.598737:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019646848:0@lo:400:kworker.0 00000100:00100000:3.0:1788850968.598759:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850968.598812:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788850968.598827:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019646976:0@lo:400:kworker.0 00000100:00100000:3.0:1788850968.598855:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850968.598888:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019647232 00000100:00100000:3.0:1788850968.598893:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019647232 00000100:00100000:3.0:1788850968.598933:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646848 00000100:00100000:3.0:1788850968.598936:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646848 00000100:00100000:3.0:1788850968.598949:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646976 00000100:00100000:3.0:1788850968.598951:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646976 00000100:00100000:3.0:1788850968.599145:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788850968.599152:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019647232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850968.599197:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf041c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019647232:12345-0@lo:400:kworker.0 Request processed in 45us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850968.599203:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788850968.599216:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788850968.599231:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019646848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850968.599263:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019646848:12345-0@lo:400:kworker.0 Request processed in 41us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850968.599269:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788850968.599280:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788850968.599286:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019646976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850968.599310:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019646976:12345-0@lo:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850968.599316:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788850968.599347:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019647104 00000100:00100000:3.0:1788850968.599352:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019647104 00000100:00100000:3.0:1788850968.599385:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788850968.599391:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019647104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850968.599433:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf043800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019647104:12345-0@lo:400:kworker.0 Request processed in 42us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850968.599439:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788850968.599470:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788850968.599475:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788850968.599509:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019646976:0@lo:400:kworker.0 00000100:00100000:3.0:1788850968.599520:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019646848:0@lo:400:kworker.0 00010000:00080000:3.0:1788850968.599566:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b8bcf1880 x1875746019647104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850968.599577:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019647104:0@lo:400:kworker.0 00000100:00100000:3.0:1788850968.599587:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019647232:0@lo:400:kworker.0 00000100:00100000:1.0:1788850968.599805:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019646720 00000100:00100000:1.0:1788850968.599811:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019646720 00000100:00100000:1.0:1788850968.599851:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788850968.599859:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019646720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850968.599903:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019646720:12345-0@lo:400:kworker.0 Request processed in 46us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850968.599910:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788850968.599946:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019646720:0@lo:400:kworker.0 00010000:00080000:2.0:1788850968.600719:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bafeaa300 x1875746019646592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850968.600744:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafeaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019646592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788850969.092689:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850969.092756:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850969.092912:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740864 00000100:00100000:3.0:1788850969.092927:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740864 00000100:00100000:3.0:1788850969.093034:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:3.0:1788850969.093047:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000740864:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788850969.093152:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000740864:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 109us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850969.093160:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00080000:1.0:1788850969.093492:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788850969.093986:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740736 00000100:00100000:0.0:1788850969.093995:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740736 00000100:00100000:0.0:1788850969.094045:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 202 00000100:00100000:0.0:1788850969.094054:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+10:2353:x1875746000740736:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788850969.094155:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+10:2353:x1875746000740736:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 102us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850969.094162:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 202 00000100:00100000:0.0:1788850969.106341:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788850969.106377:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019647360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788850969.106490:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850969.106613:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019647360 00000100:00100000:1.0:1788850969.106626:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019647360 00000100:00100000:1.0:1788850969.106698:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788850969.106709:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019647360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788850969.106757:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850969.106837:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019647360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850969.106845:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788850969.107101:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf4d3100 x1875746019647360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850969.107122:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019647360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788850969.362453:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788850970.336042:0:9456:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00010000:00010000:0.0:1788850970.385991:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850971.412459:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788850972.272632:0:9504:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 03:02:50 EDT 2026 00010000:00010000:3.0:1788850972.434272:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850973.459908:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850973.714252:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019647872:0@lo:400:kworker.0 00000100:00100000:0.0:1788850973.714332:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850973.714762:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788850973.714769:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019647488:0@lo:400:kworker.0 00000100:00100000:0.0:1788850973.714820:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850973.714844:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875746019648000:0@lo:400:kworker.0 00000100:00100000:0.0:1788850973.714869:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850973.714893:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019647616:0@lo:400:kworker.0 00000100:00100000:0.0:1788850973.714915:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850973.714931:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019648128:0@lo:400:kworker.0 00000100:00100000:0.0:1788850973.714949:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850973.714967:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788850973.714973:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019647744:0@lo:400:kworker.0 00000100:00100000:0.0:1788850973.714994:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850973.715022:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019647872 00000100:00100000:0.0:1788850973.715029:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019647872 00000100:00100000:0.0:1788850973.715077:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648128 00000100:00100000:0.0:1788850973.715080:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648128 00000100:00100000:0.0:1788850973.715102:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788850973.715110:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019647872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850973.715126:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019648256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788850973.715153:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850973.715161:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019647872:12345-0@lo:400:kworker.0 Request processed in 51us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850973.715168:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788850973.715179:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788850973.715184:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788850973.715189:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019648128:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788850973.715191:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788850973.715201:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648256 00000100:00100000:1.0:1788850973.715204:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648256 00000100:00100000:0.0:1788850973.715216:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875746019648128:12345-0@lo:400:kworker.0 Request processed in 27us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850973.715244:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788850973.715247:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788850973.715279:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b8bcf0a80 x1875746019647872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850973.715293:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019647872:0@lo:400:kworker.0 00000100:00100000:1.0:1788850973.715326:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019648256:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788850973.715328:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b8bcf1180 x1875746019648128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850973.715337:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019648128:0@lo:400:kworker.0 00000100:00100000:3.0:1788850973.716110:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019647488 00000100:00100000:3.0:1788850973.716118:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019647488 00000100:00100000:3.0:1788850973.716154:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788850973.716162:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019647488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850973.716320:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019647488:12345-0@lo:400:kworker.0 Request processed in 87us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850973.716329:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788850973.716539:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648000 00000100:00100000:3.0:1788850973.716544:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648000 00000100:00100000:3.0:1788850973.716578:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019647616 00000100:00100000:3.0:1788850973.716581:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019647616 00000100:00100000:3.0:1788850973.716592:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019647744 00000100:00100000:3.0:1788850973.716594:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019647744 00000100:00100000:3.0:1788850973.716607:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788850973.716610:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788850973.716613:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875746019648000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850973.716647:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875746019648000:12345-0@lo:400:kworker.0 Request processed in 33us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850973.716652:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788850973.716663:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788850973.716669:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019647616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850973.716776:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019647616:12345-0@lo:400:kworker.0 Request processed in 106us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850973.716807:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788850973.716819:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788850973.716827:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019647744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850973.716857:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019647744:12345-0@lo:400:kworker.0 Request processed in 32us (1862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850973.716864:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788850973.716920:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019647488:0@lo:400:kworker.0 00000100:00100000:3.0:1788850973.716934:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875746019648000:0@lo:400:kworker.0 00002000:00000024:0.0:1788850973.717034:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788850973.717089:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019648256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1765us (1933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850973.717097:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788850973.717172:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bafea9180 x1875746019648256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850973.717190:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019648256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788850973.718004:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019647744:0@lo:400:kworker.0 00000100:00100000:1.0:1788850973.718020:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019647616:0@lo:400:kworker.0 00000100:00100000:2.0:1788850974.221453:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850974.221653:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000740992 00000100:00100000:3.0:1788850974.221664:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000740992 00000100:00100000:3.0:1788850974.221725:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 204 00000100:00100000:3.0:1788850974.221735:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:2353:x1875746000740992:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788850974.221831:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:2353:x1875746000740992:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 97us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850974.221838:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 204 00000100:00100000:2.0:1788850974.224675:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850974.224867:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000741120 00000100:00100000:3.0:1788850974.224877:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000741120 00000100:00100000:3.0:1788850974.224948:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:3.0:1788850974.224958:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000741120:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788850974.225023:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000741120:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 67us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850974.225030:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00080000:2.0:1788850974.227849:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788850974.238861:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788850974.238886:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019648384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788850974.238961:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850974.239025:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648384 00000100:00100000:2.0:1788850974.239033:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648384 00000100:00100000:2.0:1788850974.239088:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788850974.239098:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019648384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788850974.239137:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788850974.239201:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019648384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850974.239209:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788850974.239266:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf4d0700 x1875746019648384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850974.239303:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019648384:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788850974.494075:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850975.511229:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850976.530156:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850977.554984:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850978.578171:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850978.834109:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019648640:0@lo:400:kworker.0 00000100:00100000:1.0:1788850978.834197:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850978.834266:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648640 00000100:00100000:1.0:1788850978.834274:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648640 00000100:00100000:1.0:1788850978.834318:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788850978.834327:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019648640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850978.834382:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019648640:12345-0@lo:400:kworker.0 Request processed in 55us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850978.834393:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788850978.834414:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019648768:0@lo:400:kworker.0 00000100:00100000:1.0:1788850978.834433:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019649152:0@lo:400:kworker.0 00000100:00100000:0.0:1788850978.834459:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850978.834493:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850978.834497:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019649280:0@lo:400:kworker.0 00000100:00100000:0.0:1788850978.834529:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850978.834549:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019648640:0@lo:400:kworker.0 00000100:00100000:0.0:1788850978.834566:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648768 00000100:00100000:0.0:1788850978.834571:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648768 00000100:00100000:1.0:1788850978.834596:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649152 00000100:00100000:1.0:1788850978.834602:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649152 00000100:00100000:0.0:1788850978.834613:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788850978.834623:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019648768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850978.834650:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788850978.834660:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019649152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850978.834675:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019648768:12345-0@lo:400:kworker.0 Request processed in 53us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850978.834685:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788850978.834713:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649280 00000100:00100000:1.0:1788850978.834719:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019649152:12345-0@lo:400:kworker.0 Request processed in 59us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850978.834719:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649280 00000100:00100000:1.0:1788850978.834726:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788850978.834746:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788850978.834772:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019649152:0@lo:400:kworker.0 00000100:00100000:0.0:1788850978.834815:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788850978.834817:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788850978.834824:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019649280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850978.834855:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019648768:0@lo:400:kworker.0 00000100:00100000:0.0:1788850978.835158:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019649280:12345-0@lo:400:kworker.0 Request processed in 336us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850978.835164:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788850978.835451:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019648896:0@lo:400:kworker.0 00000100:00100000:3.0:1788850978.835487:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850978.835512:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788850978.835519:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019648512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788850978.835543:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850978.835561:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019649024:0@lo:400:kworker.0 00000100:00100000:3.0:1788850978.835594:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850978.835622:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649024 00000100:00100000:3.0:1788850978.835627:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649024 00000100:00100000:3.0:1788850978.835661:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788850978.835667:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019649024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850978.835703:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019649024:12345-0@lo:400:kworker.0 Request processed in 36us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850978.835709:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788850978.835825:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b8bcf0700 x1875746019649024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850978.835836:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019649024:0@lo:400:kworker.0 00000100:00100000:0.0:1788850978.836034:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648896 00000100:00100000:0.0:1788850978.836038:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648896 00000100:00100000:0.0:1788850978.836067:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788850978.836073:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019648896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788850978.836226:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019648896:12345-0@lo:400:kworker.0 Request processed in 153us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850978.836232:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788850978.836337:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019648896:0@lo:400:kworker.0 00000100:00080000:0.0:1788850978.836377:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788850978.836387:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788850978.836436:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019648512 00000100:00100000:2.0:1788850978.836442:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019648512 00010000:00080000:1.0:1788850978.836476:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b8bcf2a00 x1875746019649280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850978.836488:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788850978.836489:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019649280:0@lo:400:kworker.0 00000100:00100000:2.0:1788850978.836500:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019648512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788850978.836543:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788850978.836600:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019648512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850978.836608:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788850978.836656:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bafea9500 x1875746019648512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850978.836671:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019648512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788850979.336857:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850979.336903:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850979.337031:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000741376 00000100:00100000:1.0:1788850979.337042:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000741376 00000100:00100000:1.0:1788850979.337146:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:1.0:1788850979.337165:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000741376:12345-192.168.204.6@tcp:400:kworker.0 00000100:00080000:3.0:1788850979.337212:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788850979.337261:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf040a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000741376:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 101us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850979.337268:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:2.0:1788850979.337933:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000741248 00000100:00100000:2.0:1788850979.337939:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000741248 00000100:00100000:2.0:1788850979.338006:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 206 00000100:00100000:2.0:1788850979.338015:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:2353:x1875746000741248:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788850979.338053:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:2353:x1875746000741248:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 40us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850979.338060:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 206 00000100:00100000:2.0:1788850979.350626:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4130700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019649408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788850979.350701:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850979.350772:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649408 00000100:00100000:2.0:1788850979.350810:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649408 00000100:00100000:2.0:1788850979.350859:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788850979.350869:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019649408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788850979.350911:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788850979.350964:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4132680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019649408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850979.350971:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788850979.351013:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bb4130700 x1875746019649408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850995 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850979.351033:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4130700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019649408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788850979.605440:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850980.626527:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850981.653423:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850982.680059:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850983.711816:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788850983.954486:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019649536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788850983.954564:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850983.954806:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649536 00000100:00100000:1.0:1788850983.954816:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649536 00000100:00100000:1.0:1788850983.954888:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788850983.954900:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019649536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788850983.954949:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850983.955001:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019649536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850983.955007:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788850983.955060:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bafea9500 x1875746019649536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788850999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850983.955080:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019649536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788850983.955339:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019649920:0@lo:400:kworker.0 00000100:00100000:2.0:1788850983.955375:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850983.955400:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788850983.955406:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019650048:0@lo:400:kworker.0 00000100:00100000:2.0:1788850983.955430:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850983.955461:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4130700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019649664:0@lo:400:kworker.0 00000100:00100000:2.0:1788850983.955621:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850983.955647:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019650176:0@lo:400:kworker.0 00000100:00100000:2.0:1788850983.955670:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850983.955689:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788850983.955694:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019649792:0@lo:400:kworker.0 00000100:00100000:2.0:1788850983.955716:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850983.955746:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649920 00000100:00100000:2.0:1788850983.955751:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649920 00000100:00100000:2.0:1788850983.955809:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650176 00000100:00100000:2.0:1788850983.955813:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650176 00000100:00100000:2.0:1788850983.955832:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649792 00000100:00100000:2.0:1788850983.955841:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649792 00000100:00100000:2.0:1788850983.956989:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788850983.957003:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019649920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850983.957092:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019649920:12345-0@lo:400:kworker.0 Request processed in 93us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850983.957099:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788850983.957114:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788850983.957120:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019650176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850983.957149:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019650176:12345-0@lo:400:kworker.0 Request processed in 30us (1479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850983.957154:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788850983.957164:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788850983.957169:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019649792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850983.957190:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019649792:12345-0@lo:400:kworker.0 Request processed in 21us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850983.957194:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788850983.957214:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650048 00000100:00100000:2.0:1788850983.957219:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650048 00000100:00100000:2.0:1788850983.957248:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788850983.957253:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019650048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850983.957280:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019650048:12345-0@lo:400:kworker.0 Request processed in 27us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850983.957285:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788850983.957301:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019649664 00000100:00100000:2.0:1788850983.957304:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019649664 00000100:00100000:2.0:1788850983.957322:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788850983.957328:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019649664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850983.957367:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019649664:12345-0@lo:400:kworker.0 Request processed in 39us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850983.957372:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00010000:00080000:2.0:1788850983.957429:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf4d0700 x1875746019650048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788850999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850983.957443:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019650048:0@lo:400:kworker.0 00000100:00100000:2.0:1788850983.957453:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4132d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019649920:0@lo:400:kworker.0 00000100:00100000:2.0:1788850983.957727:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019649792:0@lo:400:kworker.0 00000100:00100000:2.0:1788850983.957736:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4130700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019649664:0@lo:400:kworker.0 00000100:00100000:2.0:1788850983.957747:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019650176:0@lo:400:kworker.0 00000100:00080000:0.0:1788850983.957906:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788850983.957911:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788850983.957913:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788850984.451280:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850984.451371:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850984.451728:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000741504 00000100:00100000:1.0:1788850984.451739:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000741504 00000100:00100000:1.0:1788850984.451824:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 208 00000100:00100000:1.0:1788850984.451835:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:2353:x1875746000741504:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788850984.451910:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:2353:x1875746000741504:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 77us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850984.451918:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 208 00000100:00100000:2.0:1788850984.452114:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000741632 00000100:00100000:2.0:1788850984.452119:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000741632 00000100:00100000:2.0:1788850984.452173:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:2.0:1788850984.452182:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000741632:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788850984.452236:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000741632:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 57us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850984.452244:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00080000:1.0:1788850984.453112:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788850984.466041:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788850984.469656:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019650304:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788850984.469733:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850984.469939:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650304 00000100:00100000:3.0:1788850984.469948:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650304 00000100:00100000:3.0:1788850984.470000:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788850984.470009:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019650304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788850984.470059:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788850984.470267:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019650304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 259us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850984.470274:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788850984.471109:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bafcf2a00 x1875746019650304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851000 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850984.471155:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019650304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788850984.730306:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850985.749606:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850986.788381:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788850987.794759:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788850988.818213:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850989.075291:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019650560:0@lo:400:kworker.0 00000100:00100000:1.0:1788850989.075359:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850989.075423:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019651072:0@lo:400:kworker.0 00000100:00100000:1.0:1788850989.075445:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850989.075470:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788850989.075475:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019650432:0@lo:400:kworker.0 00000100:00100000:1.0:1788850989.075498:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850989.075516:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019650944:0@lo:400:kworker.0 00000100:00100000:1.0:1788850989.075543:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850989.075564:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019650816:0@lo:400:kworker.0 00000100:00100000:1.0:1788850989.075582:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850989.075598:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788850989.075602:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019650688:0@lo:400:kworker.0 00000100:00100000:1.0:1788850989.075618:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850989.075638:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650432 00000100:00100000:1.0:1788850989.075645:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650432 00000100:00100000:1.0:1788850989.075894:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788850989.075905:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019650432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850989.075963:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019650432:12345-0@lo:400:kworker.0 Request processed in 60us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850989.075970:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788850989.075999:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651072 00000100:00100000:1.0:1788850989.076002:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651072 00000100:00100000:1.0:1788850989.076030:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650816 00000100:00100000:1.0:1788850989.076032:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650816 00000100:00100000:1.0:1788850989.076049:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788850989.076054:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019651072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850989.076080:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019651072:12345-0@lo:400:kworker.0 Request processed in 26us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850989.076086:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788850989.076096:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788850989.076101:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019650816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850989.076123:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019650816:12345-0@lo:400:kworker.0 Request processed in 23us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850989.076138:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788850989.076155:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788850989.076159:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788850989.076181:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b98dadf80 x1875746019650816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850989.076195:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019650816:0@lo:400:kworker.0 00000100:00100000:1.0:1788850989.076220:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019650432:0@lo:400:kworker.0 00010000:00080000:1.0:1788850989.076229:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b98daf480 x1875746019651072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851005 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850989.076237:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019651072:0@lo:400:kworker.0 00000100:00100000:2.0:1788850989.076695:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650560 00000100:00100000:2.0:1788850989.076702:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650560 00000100:00100000:2.0:1788850989.076744:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650944 00000100:00100000:2.0:1788850989.076748:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650944 00000100:00100000:2.0:1788850989.076772:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019650688 00000100:00100000:2.0:1788850989.076806:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019650688 00000100:00100000:2.0:1788850989.076827:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788850989.076834:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019650560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850989.076887:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019650560:12345-0@lo:400:kworker.0 Request processed in 54us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850989.076894:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788850989.076907:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788850989.076913:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019650944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850989.076952:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019650944:12345-0@lo:400:kworker.0 Request processed in 40us (1408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850989.076958:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788850989.076968:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788850989.076973:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafeab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019650688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850989.077003:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafeab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019650688:12345-0@lo:400:kworker.0 Request processed in 30us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850989.077009:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788850989.077035:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788850989.077058:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019650688:0@lo:400:kworker.0 00000100:00100000:2.0:1788850989.077085:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019650944:0@lo:400:kworker.0 00000100:00100000:2.0:1788850989.077095:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019650560:0@lo:400:kworker.0 00000100:00100000:3.0:1788850989.077545:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019651200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788850989.077589:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850989.077640:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651200 00000100:00100000:3.0:1788850989.077655:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651200 00000100:00100000:3.0:1788850989.077854:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788850989.077863:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019651200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788850989.077895:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788850989.077946:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf042300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019651200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850989.077952:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788850989.077989:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b98daed80 x1875746019651200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850989.078006:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019651200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788850989.575941:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850989.575998:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850989.576100:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000741760 00000100:00100000:0.0:1788850989.576114:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000741760 00000100:00100000:0.0:1788850989.576190:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 210 00000100:00100000:0.0:1788850989.576202:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:2354:x1875746000741760:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788850989.576310:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+10:2354:x1875746000741760:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 110us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850989.576319:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 210 00000100:00100000:3.0:1788850989.576982:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000741888 00000100:00100000:3.0:1788850989.576991:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000741888 00000100:00100000:3.0:1788850989.577074:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 67 00000100:00100000:3.0:1788850989.577084:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000741888:12345-192.168.204.6@tcp:400:kworker.0 00000100:00080000:2.0:1788850989.577204:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788850989.577288:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000741888:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 204us (1288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850989.577297:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 67 00000100:00100000:3.0:1788850989.586627:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788850989.587902:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019651328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788850989.588028:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850989.588337:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651328 00000100:00100000:2.0:1788850989.588350:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651328 00000100:00100000:2.0:1788850989.588514:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788850989.588527:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019651328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788850989.588578:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788850989.588647:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf041180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019651328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850989.588655:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788850989.588831:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bafcf3b80 x1875746019651328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851005 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788850989.588856:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019651328:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788850989.842749:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788850990.627528:0:10135:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 03:03:08 (1788850988) === 00010000:00010000:1.0:1788850990.866451:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850991.083164:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850991.091015:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742016 00000100:00100000:1.0:1788850991.091040:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742016 00000100:00100000:1.0:1788850991.091239:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 211 00000100:00100000:1.0:1788850991.091255:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+10:8161:x1875746000742016:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788850991.091279:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850991.091305:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9baef58600/0x7ad3e1a879576c05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfe9f7 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850991.091356:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9baef58600/0x7ad3e1a879576c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9f7 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850991.091371:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9baef58600/0x7ad3e1a879576c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9f7 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850991.091382:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58600, rc 0) 00000100:00100000:1.0:1788850991.091514:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+11:8161:x1875746000742016:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 262us (8365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850991.091522:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 211 00000100:00100000:0.0:1788850991.097293:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850991.097421:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742144 00000100:00100000:1.0:1788850991.097437:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742144 00000100:00100000:1.0:1788850991.097527:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 212 00000100:00100000:1.0:1788850991.097540:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+11:8161:x1875746000742144:12345-192.168.204.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788850991.098054:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+11:8161:x1875746000742144:12345-192.168.204.6@tcp:501:mount.lustre.0 Request processed in 514us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850991.098064:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 212 00000100:00100000:2.0:1788850991.102767:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850991.106034:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742272 00000100:00100000:1.0:1788850991.106060:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742272 00000100:00100000:1.0:1788850991.106162:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 213 00000100:00100000:1.0:1788850991.106176:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+11:8161:x1875746000742272:12345-192.168.204.6@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788850991.107164:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+11:8161:x1875746000742272:12345-192.168.204.6@tcp:503:mount.lustre.0 Request processed in 983us (4404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850991.107176:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 213 00000100:00100000:3.0:1788850991.115003:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850991.115720:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742400 00000100:00100000:2.0:1788850991.115738:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742400 00000100:00100000:2.0:1788850991.115852:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 214 00000100:00100000:2.0:1788850991.115865:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+11:8165:x1875746000742400:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788850991.116652:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+11:8165:x1875746000742400:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 784us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850991.116664:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 214 00000100:00100000:0.0:1788850991.135538:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850991.136481:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742528 00000100:00100000:1.0:1788850991.136498:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742528 00000100:00100000:1.0:1788850991.136594:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 215 00000100:00100000:1.0:1788850991.136610:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+11:8165:x1875746000742528:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788850991.137268:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+11:8165:x1875746000742528:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 657us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850991.137281:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 215 00000100:00100000:2.0:1788850991.140687:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850991.141479:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742656 00000100:00100000:1.0:1788850991.141498:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742656 00000100:00100000:1.0:1788850991.141586:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 216 00000100:00100000:1.0:1788850991.141599:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+11:8161:x1875746000742656:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788850991.141643:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788850991.141674:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9baef59400/0x7ad3e1a879576c0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfea21 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850991.141716:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9baef59400/0x7ad3e1a879576c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea21 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850991.141729:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9baef59400/0x7ad3e1a879576c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea21 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788850991.141739:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59400, rc 0) 00000100:00100000:1.0:1788850991.141870:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+12:8161:x1875746000742656:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 273us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850991.141878:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 216 00000100:00100000:2.0:1788850991.155990:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850991.156215:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742784 00000100:00100000:1.0:1788850991.156231:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742784 00000100:00100000:1.0:1788850991.156311:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 217 00000100:00100000:1.0:1788850991.156325:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+12:8161:x1875746000742784:12345-192.168.204.6@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788850991.156375:0:5853:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788850991.156415:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788850991.156421:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788850991.156425:0:5853:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788850991.156427:0:5853:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788850991.160979:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+12:8161:x1875746000742784:12345-192.168.204.6@tcp:256:mount.lustre.0 Request processed in 4637us (4987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850991.161002:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 217 00000100:00100000:3.0:1788850991.165509:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850991.165757:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000742912 00000100:00100000:0.0:1788850991.165772:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000742912 00000100:00100000:0.0:1788850991.165905:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 218 00000100:00100000:0.0:1788850991.165918:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+12:8161:x1875746000742912:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788850991.165943:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788850991.165971:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576c13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfea28 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850991.166011:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576c13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea28 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850991.166025:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576c13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea28 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788850991.166057:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7400, rc 0) 00000100:00100000:0.0:1788850991.166161:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:8161:x1875746000742912:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 245us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850991.166169:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 218 00000100:00100000:2.0:1788850991.169907:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850991.170037:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743040 00000100:00100000:1.0:1788850991.170053:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743040 00000100:00100000:1.0:1788850991.170146:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 219 00000100:00100000:1.0:1788850991.170158:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:8161:x1875746000743040:12345-192.168.204.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788850991.170581:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:8161:x1875746000743040:12345-192.168.204.6@tcp:501:mount.lustre.0 Request processed in 423us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850991.170592:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 219 00000100:00100000:3.0:1788850991.173658:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850991.173830:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743168 00000100:00100000:2.0:1788850991.173846:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743168 00000100:00100000:2.0:1788850991.173942:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 220 00000100:00100000:2.0:1788850991.173955:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:8161:x1875746000743168:12345-192.168.204.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788850991.174343:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:8161:x1875746000743168:12345-192.168.204.6@tcp:503:mount.lustre.0 Request processed in 380us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850991.174362:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 220 00000100:00100000:3.0:1788850991.177068:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850991.177243:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743296 00000100:00100000:0.0:1788850991.177260:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743296 00000100:00100000:0.0:1788850991.177350:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 221 00000100:00100000:0.0:1788850991.177365:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:8170:x1875746000743296:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788850991.177713:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:8170:x1875746000743296:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 351us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850991.177722:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 221 00000100:00100000:3.0:1788850991.185512:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850991.185651:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743424 00000100:00100000:1.0:1788850991.185667:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743424 00000100:00100000:1.0:1788850991.185746:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 222 00000100:00100000:1.0:1788850991.185759:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:8170:x1875746000743424:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788850991.186182:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:8170:x1875746000743424:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 422us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850991.186192:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 222 00000100:00100000:3.0:1788850991.199196:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850991.199445:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743552 00000100:00100000:2.0:1788850991.199460:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743552 00000100:00100000:2.0:1788850991.199521:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:2.0:1788850991.199531:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1875746000743552:12345-192.168.204.6@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788850991.199573:0:5861:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 37963b51-fe0d-42c0-b479-a7af644fd745@192.168.204.6@tcp t0 exp 0000000000000000 cur 324 last 0 00000020:00000080:2.0:1788850991.199623:0:5861:0:(genops.c:1384:class_connect()) connect: client 37963b51-fe0d-42c0-b479-a7af644fd745, cookie 0x7ad3e1a879576c1a 00000004:00100000:2.0:1788850991.199663:0:5861:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788850991.200055:0:5861:0:(import.c:65:import_set_state_nolock()) ffff8a9b8da69800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788850991.200148:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf040380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37963b51-fe0d-42c0-b479-a7af644fd745+6:2350:x1875746000743552:12345-192.168.204.6@tcp:38:mount.lustre.0 Request processed in 616us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850991.200158:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:3.0:1788850991.203875:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850991.204858:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743936 00000100:00100000:2.0:1788850991.204877:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743936 00000100:00100000:2.0:1788850991.205001:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:2.0:1788850991.205026:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000743936:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788850991.205156:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf041880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000743936:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 144us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850991.205164:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00080000:1.0:1788850991.205821:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788850991.207471:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850991.207521:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850991.212293:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743680 00000100:00100000:1.0:1788850991.212319:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743680 00000100:00100000:1.0:1788850991.212571:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000743808 00000100:00100000:1.0:1788850991.212576:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000743808 00000100:00100000:1.0:1788850991.212615:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:1.0:1788850991.212629:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+7:0:x1875746000743680:12345-192.168.204.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788850991.212694:0:5863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788850991.213046:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+7:0:x1875746000743680:12345-192.168.204.6@tcp:41:mount.lustre.0 Request processed in 410us (5579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850991.213060:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:1.0:1788850991.213101:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:1.0:1788850991.213114:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+6:8161:x1875746000743808:12345-192.168.204.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788850991.213173:0:5863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788850991.213204:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+6:8161:x1875746000743808:12345-192.168.204.6@tcp:41:mount.lustre.0 Request processed in 95us (5682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850991.213211:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00080000:3.0:1788850991.215547:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788850991.216011:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850991.216891:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744064 00000100:00100000:1.0:1788850991.216911:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744064 00000100:00100000:1.0:1788850991.217000:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:1.0:1788850991.217013:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+6:8161:x1875746000744064:12345-192.168.204.6@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788850991.217366:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98daea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+6:8161:x1875746000744064:12345-192.168.204.6@tcp:40:mount.lustre.0 Request processed in 353us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850991.217377:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:1.0:1788850991.220925:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850991.221048:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850991.221102:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788850991.221145:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744192 00000100:00100000:1.0:1788850991.221157:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744192 00000100:00100000:1.0:1788850991.221204:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744320 00000100:00100000:1.0:1788850991.221207:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744320 00000100:00100000:1.0:1788850991.221229:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:1.0:1788850991.221239:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875746000744192:12345-192.168.204.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788850991.221283:0:6704:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 37963b51-fe0d-42c0-b479-a7af644fd745@192.168.204.6@tcp t0 exp 0000000000000000 cur 324 last 0 00000100:00100000:3.0:1788850991.221542:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:3.0:1788850991.221549:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875746000744320:12345-192.168.204.6@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788850991.221570:0:6707:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 37963b51-fe0d-42c0-b479-a7af644fd745@192.168.204.6@tcp t0 exp 0000000000000000 cur 324 last 0 00000020:00000080:3.0:1788850991.221606:0:6707:0:(genops.c:1384:class_connect()) connect: client 37963b51-fe0d-42c0-b479-a7af644fd745, cookie 0x7ad3e1a879576c28 00002000:00100000:3.0:1788850991.221625:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 37963b51-fe0d-42c0-b479-a7af644fd745/ffff8a9bb6ff2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788850991.221660:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788850991.222045:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788850991.222106:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8a9bb6ff2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788850991.222200:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:37963b51-fe0d-42c0-b479-a7af644fd745+6:2350:x1875746000744320:12345-192.168.204.6@tcp:8:mount.lustre.0 Request processed in 648us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850991.222210:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00000020:00000080:1.0:1788850991.222899:0:6704:0:(genops.c:1384:class_connect()) connect: client 37963b51-fe0d-42c0-b479-a7af644fd745, cookie 0x7ad3e1a879576c21 00002000:00100000:1.0:1788850991.222915:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 37963b51-fe0d-42c0-b479-a7af644fd745/ffff8a9bc1e04000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788850991.222942:0:6704:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788850991.223528:0:6704:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788850991.223730:0:6704:0:(import.c:65:import_set_state_nolock()) ffff8a9bc1e04800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788850991.223845:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37963b51-fe0d-42c0-b479-a7af644fd745+6:2350:x1875746000744192:12345-192.168.204.6@tcp:8:mount.lustre.0 Request processed in 2604us (2793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850991.223856:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:0.0:1788850991.226950:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744448 00000100:00100000:0.0:1788850991.226974:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744448 00000100:00100000:0.0:1788850991.227520:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:0.0:1788850991.227536:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37963b51-fe0d-42c0-b479-a7af644fd745+6:8161:x1875746000744448:12345-192.168.204.6@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788850991.227670:0:5864:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788850991.227837:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:37963b51-fe0d-42c0-b479-a7af644fd745+6:8161:x1875746000744448:12345-192.168.204.6@tcp:33:mount.lustre.0 Request processed in 305us (6927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850991.227847:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 1 00010000:00010000:2.0:1788850991.903455:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850992.914846:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788850993.772213:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 37963b51-fe0d-42c0-b479-a7af644fd745 00000001:00100000:0.0:1788850993.788069:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 37963b51-fe0d-42c0-b479-a7af644fd745 00000001:00100000:2.0:1788850993.836443:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 37963b51-fe0d-42c0-b479-a7af644fd745 00010000:00010000:2.0:1788850993.947102:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788850994.194222:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019651456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788850994.194528:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850994.195167:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019651712:0@lo:400:kworker.0 00000100:00100000:1.0:1788850994.195167:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651456 00000100:00100000:1.0:1788850994.195179:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651456 00000100:00100000:2.0:1788850994.195228:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850994.195252:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788850994.195258:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019651840:0@lo:400:kworker.0 00000100:00100000:2.0:1788850994.196033:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788850994.196080:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788850994.196491:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651712 00000100:00100000:2.0:1788850994.196499:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651712 00000100:00100000:2.0:1788850994.196546:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651840 00000100:00100000:2.0:1788850994.196548:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651840 00000100:00100000:2.0:1788850994.196577:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788850994.196587:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019651712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850994.196652:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019651712:12345-0@lo:400:kworker.0 Request processed in 67us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850994.196660:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788850994.196677:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788850994.196683:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019651840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850994.196705:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019651840:12345-0@lo:400:kworker.0 Request processed in 23us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850994.196711:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788850994.196743:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019651584:0@lo:400:kworker.0 00000100:00100000:2.0:1788850994.196801:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850994.197401:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019652096:0@lo:400:kworker.0 00000100:00100000:2.0:1788850994.197445:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850994.197479:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788850994.197486:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019651968:0@lo:400:kworker.0 00000100:00100000:2.0:1788850994.197514:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788850994.197572:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651584 00000100:00100000:2.0:1788850994.197578:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651584 00000100:00100000:2.0:1788850994.197621:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788850994.197629:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019651584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850994.197675:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019651584:12345-0@lo:400:kworker.0 Request processed in 46us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850994.197682:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788850994.197719:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019651968 00000100:00100000:2.0:1788850994.197723:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019651968 00000100:00100000:2.0:1788850994.197758:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788850994.197764:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019651968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850994.197835:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019651968:12345-0@lo:400:kworker.0 Request processed in 60us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850994.198282:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788850994.198298:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019651456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788850994.198343:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850994.198395:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019651456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (3869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850994.198401:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788850994.200140:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788850994.200187:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788850994.200194:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788850994.200250:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019651840:0@lo:400:kworker.0 00000100:00100000:2.0:1788850994.200266:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019651712:0@lo:400:kworker.0 00010000:00080000:2.0:1788850994.200479:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b98daca80 x1875746019651456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850994.200501:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019651456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788850994.200528:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652096 00000100:00100000:2.0:1788850994.200535:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652096 00000100:00100000:2.0:1788850994.200608:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788850994.200617:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019652096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788850994.200693:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019652096:12345-0@lo:400:kworker.0 Request processed in 78us (3249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850994.200716:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:2.0:1788850994.200747:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bafcf3100 x1875746019651968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850994.200759:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019651968:0@lo:400:kworker.0 00000100:00100000:2.0:1788850994.200769:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019651584:0@lo:400:kworker.0 00000100:00080000:3.0:1788850994.201040:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788850994.203427:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019652096:0@lo:400:kworker.0 00000100:00100000:1.0:1788850994.709635:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788850994.709675:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019652224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788850994.709825:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850994.709955:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652224 00000100:00100000:0.0:1788850994.709966:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652224 00000100:00100000:0.0:1788850994.710042:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788850994.710054:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019652224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788850994.710129:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788850994.710211:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019652224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850994.710220:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788850994.710256:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b98dae300 x1875746019652224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850994.710282:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019652224:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788850994.975594:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850995.986366:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788850996.227571:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788850996.229206:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744576 00000100:00100000:0.0:1788850996.229238:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744576 00000100:00100000:0.0:1788850996.229346:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 224 00000100:00100000:0.0:1788850996.229361:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000744576:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788850996.229507:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000744576:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 149us (1953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850996.229516:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 224 00000100:00100000:3.0:1788850996.231663:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850996.237643:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744704 00000100:00100000:2.0:1788850996.237669:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744704 00000100:00100000:2.0:1788850996.237844:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 72 00000100:00100000:2.0:1788850996.237859:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000744704:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788850996.237980:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000744704:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 126us (6330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850996.237988:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 72 00000100:00080000:3.0:1788850996.238088:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788850996.247639:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850996.247703:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788850996.247749:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788850996.248950:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744960 00000100:00100000:2.0:1788850996.248980:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744960 00000100:00100000:2.0:1788850996.249101:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745088 00000100:00100000:2.0:1788850996.249106:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745088 00000100:00100000:2.0:1788850996.249138:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:2.0:1788850996.249151:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2354:x1875746000744960:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788850996.249516:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2354:x1875746000744960:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 367us (1891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850996.249525:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:2.0:1788850996.249550:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:2.0:1788850996.249574:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2354:x1875746000745088:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788850996.249607:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2354:x1875746000745088:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 35us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1788850996.249614:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:0.0:1788850996.250682:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000744832 00000100:00100000:0.0:1788850996.250694:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000744832 00000100:00100000:0.0:1788850996.250758:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00100000:0.0:1788850996.250767:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37963b51-fe0d-42c0-b479-a7af644fd745+5:2354:x1875746000744832:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788850996.250873:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37963b51-fe0d-42c0-b479-a7af644fd745+5:2354:x1875746000744832:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 107us (3169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788850996.250880:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00080000:3.0:1788850996.252678:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788850996.252692:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788850996.252695:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788850997.017271:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788850998.036916:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788850998.109074:0:10332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788850999.078291:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788850999.319142:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019652352:0@lo:400:kworker.0 00000100:00100000:3.0:1788850999.319336:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019652736:0@lo:400:kworker.0 00000100:00100000:0.0:1788850999.323721:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019652480:0@lo:400:kworker.0 00000100:00100000:3.0:1788850999.323958:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788850999.324026:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652736 00000100:00100000:3.0:1788850999.324036:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652736 00000100:00100000:3.0:1788850999.324116:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788850999.324126:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019652736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850999.324195:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019652736:12345-0@lo:400:kworker.0 Request processed in 71us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850999.324203:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788850999.324239:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788850999.324300:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf0b1500 x1875746019652736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788850999.324319:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019652736:0@lo:400:kworker.0 00000100:00100000:1.0:1788850999.324831:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850999.324893:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019652864:0@lo:400:kworker.0 00000100:00100000:3.0:1788850999.328067:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652352 00000100:00100000:3.0:1788850999.328089:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652352 00000100:00100000:3.0:1788850999.328169:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788850999.328192:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019652352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850999.328314:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019652352:12345-0@lo:400:kworker.0 Request processed in 125us (3485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850999.328322:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788850999.330389:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850999.330471:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019652352:0@lo:400:kworker.0 00000100:00100000:1.0:1788850999.330515:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875746019652608:0@lo:400:kworker.0 00000100:00100000:1.0:1788850999.330543:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850999.330580:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019653120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788850999.330607:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850999.330654:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652864 00000100:00100000:1.0:1788850999.330661:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652864 00000100:00100000:3.0:1788850999.330693:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652608 00000100:00100000:3.0:1788850999.330720:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652608 00000100:00100000:1.0:1788850999.330744:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788850999.330758:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019652864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850999.330826:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788850999.330839:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875746019652608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850999.330852:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019652864:12345-0@lo:400:kworker.0 Request processed in 97us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850999.330861:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788850999.330889:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019653120 00000100:00100000:1.0:1788850999.330894:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019653120 00000100:00100000:1.0:1788850999.330930:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788850999.330943:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019653120:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788850999.330950:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875746019652608:12345-0@lo:400:kworker.0 Request processed in 110us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850999.330962:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00002000:00000024:1.0:1788850999.330984:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850999.331041:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019653120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850999.331048:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788850999.331071:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788850999.331076:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788850999.331107:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875746019652608:0@lo:400:kworker.0 00010000:00080000:1.0:1788850999.331119:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b98dad180 x1875746019653120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850999.331134:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019653120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788850999.331161:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019652864:0@lo:400:kworker.0 00000100:00100000:0.0:1788850999.332158:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788850999.332627:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019652992:0@lo:400:kworker.0 00000100:00100000:0.0:1788850999.332680:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850999.332953:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652480 00000100:00100000:1.0:1788850999.332974:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652480 00000100:00100000:1.0:1788850999.333036:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788850999.333045:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019652480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788850999.333126:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019652480:12345-0@lo:400:kworker.0 Request processed in 82us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850999.333134:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788850999.333180:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019652480:0@lo:400:kworker.0 00000100:00100000:3.0:1788850999.333754:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019652992 00000100:00100000:3.0:1788850999.333775:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019652992 00000100:00100000:3.0:1788850999.335234:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788850999.335258:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019652992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788850999.335382:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019652992:12345-0@lo:400:kworker.0 Request processed in 137us (2701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788850999.335391:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788850999.335501:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf0b0700 x1875746019652992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788850999.335521:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019652992:0@lo:400:kworker.0 00000100:00100000:1.0:1788850999.828989:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019653248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788850999.829094:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788850999.829180:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019653248 00000100:00100000:1.0:1788850999.829188:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019653248 00000100:00100000:1.0:1788850999.829249:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788850999.829260:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019653248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788850999.829303:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788850999.829351:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019653248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788850999.829358:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788850999.829421:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf0b3b80 x1875746019653248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788850999.829442:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019653248:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788851000.082089:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851001.109703:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851001.350710:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851001.351422:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851001.351463:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851001.351730:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851001.352024:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745216 00000100:00100000:2.0:1788851001.352035:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745216 00000100:00100000:2.0:1788851001.352103:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 226 00000100:00100000:2.0:1788851001.352114:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000745216:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788851001.352205:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000745216:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 93us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851001.352212:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 226 00000100:00100000:3.0:1788851001.352495:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745600 00000100:00100000:3.0:1788851001.352500:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745600 00000100:00100000:3.0:1788851001.352544:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:3.0:1788851001.352552:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000745600:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851001.352583:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000745600:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 33us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851001.352589:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00080000:2.0:1788851001.352901:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851001.359672:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851001.359916:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745728 00000100:00100000:0.0:1788851001.359937:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745728 00000100:00100000:0.0:1788851001.360021:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:0.0:1788851001.360033:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000745728:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851001.360115:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000745728:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 85us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851001.360134:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00080000:0.0:1788851001.360549:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851001.362348:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745344 00000100:00100000:1.0:1788851001.362368:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745344 00000100:00100000:1.0:1788851001.362530:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745472 00000100:00100000:1.0:1788851001.362534:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745472 00000100:00080000:0.0:1788851001.362623:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851001.362741:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 77 00000100:00100000:1.0:1788851001.362754:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000745344:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851001.362900:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000745344:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 149us (12213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851001.362909:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 77 00000100:00100000:1.0:1788851001.362940:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 78 00000100:00100000:1.0:1788851001.362948:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000745472:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851001.362974:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000745472:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 27us (11244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851001.362980:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 78 00010000:00010000:2.0:1788851002.131067:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851003.156007:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851004.182904:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851004.434035:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019653760:0@lo:400:kworker.0 00000100:00100000:1.0:1788851004.434127:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851004.434205:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788851004.434212:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019653376:0@lo:400:kworker.0 00000100:00100000:1.0:1788851004.434249:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851004.434282:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019653888:0@lo:400:kworker.0 00000100:00100000:1.0:1788851004.434311:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851004.434339:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019653504:0@lo:400:kworker.0 00000100:00100000:1.0:1788851004.434360:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851004.434374:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019654016:0@lo:400:kworker.0 00000100:00100000:1.0:1788851004.434394:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851004.434414:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851004.434419:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019653632:0@lo:400:kworker.0 00000100:00100000:1.0:1788851004.434438:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851004.434472:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019653760 00000100:00100000:1.0:1788851004.434480:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019653760 00000100:00100000:1.0:1788851004.434555:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654016 00000100:00100000:1.0:1788851004.434560:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654016 00000100:00100000:1.0:1788851004.434584:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788851004.434593:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019653760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851004.434862:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019653760:12345-0@lo:400:kworker.0 Request processed in 270us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851004.434870:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788851004.434886:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788851004.434892:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019654016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851004.434925:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019654016:12345-0@lo:400:kworker.0 Request processed in 33us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851004.434930:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788851004.434949:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019653376 00000100:00100000:1.0:1788851004.434953:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019653376 00000100:00100000:1.0:1788851004.434978:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788851004.434985:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019653376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851004.435014:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019653376:12345-0@lo:400:kworker.0 Request processed in 30us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851004.435020:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788851004.435043:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019653888 00000100:00100000:1.0:1788851004.435047:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019653888 00000100:00100000:1.0:1788851004.435076:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019653504 00000100:00100000:1.0:1788851004.435080:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019653504 00000100:00100000:1.0:1788851004.435091:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019653632 00000100:00100000:1.0:1788851004.435094:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019653632 00000100:00100000:1.0:1788851004.435107:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788851004.435112:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019653888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851004.435139:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019653888:12345-0@lo:400:kworker.0 Request processed in 27us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851004.435151:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788851004.435164:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788851004.435171:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019653504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851004.435196:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019653504:12345-0@lo:400:kworker.0 Request processed in 26us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851004.435201:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788851004.435211:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788851004.435217:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019653632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851004.435240:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019653632:12345-0@lo:400:kworker.0 Request processed in 24us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851004.435244:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788851004.435298:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019653632:0@lo:400:kworker.0 00000100:00100000:1.0:1788851004.435308:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019653504:0@lo:400:kworker.0 00010000:00080000:1.0:1788851004.435318:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf0b3480 x1875746019654016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851004.435328:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019654016:0@lo:400:kworker.0 00000100:00100000:1.0:1788851004.435354:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019653376:0@lo:400:kworker.0 00000100:00100000:1.0:1788851004.435363:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019653888:0@lo:400:kworker.0 00010000:00080000:1.0:1788851004.435371:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf0b1f80 x1875746019653760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851004.435379:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019653760:0@lo:400:kworker.0 00000100:00080000:0.0:1788851004.435825:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788851004.435832:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788851004.435834:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851004.435887:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851004.435900:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019654144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851004.435941:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851004.437874:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654144 00000100:00100000:0.0:1788851004.437890:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654144 00000100:00100000:0.0:1788851004.437951:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788851004.437962:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019654144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851004.438004:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788851004.438099:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019654144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851004.438107:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788851004.438200:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b98daf800 x1875746019654144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851004.438220:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019654144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851004.957364:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019654272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851004.957581:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851004.957672:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654272 00000100:00100000:1.0:1788851004.957680:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654272 00000100:00100000:1.0:1788851004.957727:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788851004.957738:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019654272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851004.957806:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851004.957855:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019654272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851004.957862:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788851004.957904:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf0b1f80 x1875746019654272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851004.957925:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019654272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788851005.202729:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851006.239569:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851006.464973:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851006.465086:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851006.465125:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851006.465155:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851006.465237:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851006.465276:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000746368 00000100:00100000:3.0:1788851006.465288:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000746368 00000100:00100000:3.0:1788851006.465365:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000746240 00000100:00100000:3.0:1788851006.465368:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000746240 00000100:00100000:3.0:1788851006.465437:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:3.0:1788851006.465450:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9ba058e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000746368:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851006.465544:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9ba058e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000746368:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 97us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851006.465552:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:3.0:1788851006.465747:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:3.0:1788851006.465755:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2354:x1875746000746240:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851006.465822:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2354:x1875746000746240:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851006.465830:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:3.0:1788851006.465851:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000746112 00000100:00100000:3.0:1788851006.465855:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000746112 00000100:00100000:3.0:1788851006.465885:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745984 00000100:00100000:3.0:1788851006.465888:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745984 00000100:00100000:3.0:1788851006.465911:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 82 00000100:00100000:3.0:1788851006.465917:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000746112:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851006.465944:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000746112:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 28us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851006.465965:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 82 00000100:00100000:3.0:1788851006.465978:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 83 00000100:00100000:3.0:1788851006.465983:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000745984:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851006.466006:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000745984:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 23us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851006.466011:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 83 00000100:00080000:3.0:1788851006.466031:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788851006.466037:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788851006.466039:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851006.469773:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000745856 00000100:00100000:2.0:1788851006.469811:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000745856 00000100:00100000:2.0:1788851006.469890:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 228 00000100:00100000:2.0:1788851006.469903:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000745856:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788851006.470000:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000745856:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 100us (5042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851006.470018:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 228 00010000:00010000:0.0:1788851007.252496:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851008.274400:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851009.298101:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851009.555262:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019654528:0@lo:400:kworker.0 00000100:00100000:0.0:1788851009.555355:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851009.555415:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019655040:0@lo:400:kworker.0 00000100:00100000:0.0:1788851009.555458:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851009.555493:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851009.555500:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019654656:0@lo:400:kworker.0 00000100:00100000:0.0:1788851009.555523:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851009.555568:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654528 00000100:00100000:0.0:1788851009.555579:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654528 00000100:00100000:0.0:1788851009.555644:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654656 00000100:00100000:0.0:1788851009.555769:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654656 00000100:00100000:0.0:1788851009.555945:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788851009.555956:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019654528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851009.556025:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98daf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019654528:12345-0@lo:400:kworker.0 Request processed in 72us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851009.556033:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788851009.556059:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788851009.556066:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019654656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851009.556094:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019654656:12345-0@lo:400:kworker.0 Request processed in 29us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851009.556100:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788851009.556123:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655040 00000100:00100000:0.0:1788851009.556128:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655040 00000100:00100000:0.0:1788851009.556162:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788851009.556171:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019655040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851009.556207:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019655040:12345-0@lo:400:kworker.0 Request processed in 37us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851009.556213:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1788851009.556237:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788851009.556244:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851009.556306:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019654656:0@lo:400:kworker.0 00000100:00100000:0.0:1788851009.556318:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019654528:0@lo:400:kworker.0 00010000:00080000:0.0:1788851009.556331:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b98dadc00 x1875746019655040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851009.556343:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019655040:0@lo:400:kworker.0 00000100:00100000:1.0:1788851009.556454:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019654400:0@lo:400:kworker.0 00000100:00100000:1.0:1788851009.556501:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851009.556550:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019654912:0@lo:400:kworker.0 00000100:00100000:1.0:1788851009.556574:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851009.556608:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788851009.556615:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019654784:0@lo:400:kworker.0 00000100:00100000:1.0:1788851009.556638:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851009.556841:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654912 00000100:00100000:1.0:1788851009.556847:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654912 00000100:00100000:1.0:1788851009.556901:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788851009.556909:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019654912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851009.556950:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019654912:12345-0@lo:400:kworker.0 Request processed in 42us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851009.556967:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788851009.556986:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654784 00000100:00100000:1.0:1788851009.556991:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654784 00000100:00100000:1.0:1788851009.557018:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788851009.557024:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019654784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851009.557055:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019654784:12345-0@lo:400:kworker.0 Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851009.557060:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788851009.557086:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b98dad500 x1875746019654784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851009.557098:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019654784:0@lo:400:kworker.0 00000100:00100000:1.0:1788851009.557106:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019654912:0@lo:400:kworker.0 00000100:00080000:1.0:1788851009.557129:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788851009.557133:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851009.557363:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019654400 00000100:00100000:0.0:1788851009.557368:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019654400 00000100:00100000:0.0:1788851009.557412:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788851009.557420:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019654400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851009.557459:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019654400:12345-0@lo:400:kworker.0 Request processed in 40us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851009.557465:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788851009.562051:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019654400:0@lo:400:kworker.0 00000100:00100000:1.0:1788851009.568031:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019655168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851009.568132:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851009.568211:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655168 00000100:00100000:1.0:1788851009.568223:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655168 00000100:00100000:1.0:1788851009.568287:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788851009.568299:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019655168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788851009.568342:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851009.568391:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019655168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851009.568413:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788851009.568464:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b98dadc00 x1875746019655168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851009.568486:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019655168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851010.073817:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019655296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851010.073897:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851010.075480:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655296 00000100:00100000:0.0:1788851010.075494:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655296 00000100:00100000:0.0:1788851010.075563:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788851010.075575:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019655296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788851010.075619:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788851010.075700:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019655296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851010.075707:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788851010.075747:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc1ee2a00 x1875746019655296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851010.075805:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019655296:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788851010.322070:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851011.347529:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851011.592624:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851011.592684:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851011.592719:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851011.592759:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851011.592887:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851011.593840:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000746496 00000100:00100000:2.0:1788851011.593859:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000746496 00000100:00100000:2.0:1788851011.593942:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 230 00000100:00100000:2.0:1788851011.593954:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2354:x1875746000746496:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788851011.594054:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2354:x1875746000746496:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 102us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851011.594061:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 230 00000100:00100000:1.0:1788851011.599505:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000746752 00000100:00100000:1.0:1788851011.599526:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000746752 00000100:00100000:1.0:1788851011.599612:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000746624 00000100:00100000:1.0:1788851011.599616:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000746624 00000100:00100000:1.0:1788851011.600633:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 87 00000100:00100000:1.0:1788851011.600655:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37963b51-fe0d-42c0-b479-a7af644fd745+5:2354:x1875746000746752:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851011.601008:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37963b51-fe0d-42c0-b479-a7af644fd745+5:2354:x1875746000746752:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 360us (8332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851011.601019:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 87 00000100:00100000:3.0:1788851011.601065:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 88 00000100:00100000:3.0:1788851011.601079:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000746624:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851011.601310:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000746624:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 234us (8590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851011.601317:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 88 00000100:00100000:1.0:1788851011.602285:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000746880 00000100:00100000:1.0:1788851011.602300:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000746880 00000100:00100000:1.0:1788851011.602348:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747008 00000100:00100000:1.0:1788851011.602351:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747008 00000100:00100000:1.0:1788851011.603295:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:1.0:1788851011.603313:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2350:x1875746000746880:12345-192.168.204.6@tcp:9:kworker.0 00000020:00000080:1.0:1788851011.603347:0:8281:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576c21 00000100:00080000:1.0:1788851011.603360:0:8281:0:(import.c:65:import_set_state_nolock()) ffff8a9bc1e04800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788851011.604548:0:8281:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788851011.605040:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:3.0:1788851011.605061:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2350:x1875746000747008:12345-192.168.204.6@tcp:9:kworker.0 00000020:00000080:3.0:1788851011.605093:0:6706:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576c28 00000100:00080000:3.0:1788851011.605113:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8a9bb6ff2800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788851011.605777:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788851011.605896:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788851011.607118:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:37963b51-fe0d-42c0-b479-a7af644fd745+2:2350:x1875746000746880:12345-192.168.204.6@tcp:9:kworker.0 Request processed in 3801us (14345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851011.607133:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00080000:1.0:1788851011.607180:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851011.607186:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788851011.607190:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788851011.612838:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851011.617163:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:37963b51-fe0d-42c0-b479-a7af644fd745+2:2350:x1875746000747008:12345-192.168.204.6@tcp:9:kworker.0 Request processed in 12089us (24253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851011.617183:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00010000:00010000:2.0:1788851012.372274:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851013.397666:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788851014.220751:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 37963b51-fe0d-42c0-b479-a7af644fd745 00000020:00000080:3.0:1788851014.220762:0:7656:0:(genops.c:885:class_export_put()) final put ffff8a9bb6ff2000/37963b51-fe0d-42c0-b479-a7af644fd745 00000020:00000080:1.0:1788851014.220988:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb6ff2000/37963b51-fe0d-42c0-b479-a7af644fd745 for lustre-OST0001 00000020:00000080:1.0:1788851014.221088:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9bb6ff2800 for lustre-OST0001 00000001:00100000:2.0:1788851014.235801:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 37963b51-fe0d-42c0-b479-a7af644fd745 00000020:00000080:2.0:1788851014.235810:0:6732:0:(genops.c:885:class_export_put()) final put ffff8a9bc1e04000/37963b51-fe0d-42c0-b479-a7af644fd745 00000020:00000080:1.0:1788851014.235967:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bc1e04000/37963b51-fe0d-42c0-b479-a7af644fd745 for lustre-OST0000 00000020:00000080:1.0:1788851014.236106:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9bc1e04800 for lustre-OST0000 00010000:00010000:2.0:1788851014.420850:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851014.674174:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851014.674203:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019655424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851014.674294:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851014.674419:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655424 00000100:00100000:0.0:1788851014.674441:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655424 00000100:00100000:0.0:1788851014.674531:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788851014.674542:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019655424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851014.674595:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788851014.674649:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019655424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851014.674657:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1788851014.674864:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788851014.674904:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b98dace00 x1875746019655424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851014.674927:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019655424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851014.675275:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019655936:0@lo:400:kworker.0 00000100:00100000:1.0:1788851014.675324:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851014.675353:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788851014.675359:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019655808:0@lo:400:kworker.0 00000100:00100000:1.0:1788851014.675386:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851014.675415:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655936 00000100:00100000:1.0:1788851014.675420:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655936 00000100:00100000:2.0:1788851014.675603:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019655680:0@lo:400:kworker.0 00000100:00100000:2.0:1788851014.675637:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851014.675674:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788851014.675679:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019655552:0@lo:400:kworker.0 00000100:00100000:2.0:1788851014.675707:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851014.675734:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019656064:0@lo:400:kworker.0 00000100:00100000:2.0:1788851014.675755:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851014.675822:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655808 00000100:00100000:2.0:1788851014.675826:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655808 00000100:00100000:2.0:1788851014.675866:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655680 00000100:00100000:2.0:1788851014.675870:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655680 00000100:00100000:2.0:1788851014.675884:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656064 00000100:00100000:2.0:1788851014.675887:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656064 00000100:00100000:2.0:1788851014.675903:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788851014.675911:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019655808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851014.675958:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019655808:12345-0@lo:400:kworker.0 Request processed in 47us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851014.675965:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788851014.675983:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788851014.675988:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019655680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851014.676021:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019655680:12345-0@lo:400:kworker.0 Request processed in 33us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851014.676028:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788851014.676040:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788851014.676046:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019656064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851014.676073:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019656064:12345-0@lo:400:kworker.0 Request processed in 27us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851014.676079:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788851014.676098:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019655552 00000100:00100000:2.0:1788851014.676108:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019655552 00000100:00100000:2.0:1788851014.676135:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788851014.676141:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019655552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851014.676172:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019655552:12345-0@lo:400:kworker.0 Request processed in 31us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851014.676177:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00080000:2.0:1788851014.676217:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851014.676223:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851014.676264:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019655808:0@lo:400:kworker.0 00000100:00100000:2.0:1788851014.676290:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019655552:0@lo:400:kworker.0 00000100:00100000:2.0:1788851014.676298:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019656064:0@lo:400:kworker.0 00000100:00100000:2.0:1788851014.676307:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019655680:0@lo:400:kworker.0 00000100:00100000:1.0:1788851014.676437:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788851014.676447:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019655936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851014.676628:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019655936:12345-0@lo:400:kworker.0 Request processed in 183us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851014.676635:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1788851014.676738:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b8bcf3b80 x1875746019655936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851014.676750:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019655936:0@lo:400:kworker.0 00000100:00100000:1.0:1788851015.186899:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851015.186927:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019656192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851015.187001:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851015.187068:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656192 00000100:00100000:1.0:1788851015.187084:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656192 00000100:00100000:1.0:1788851015.187135:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788851015.187145:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019656192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851015.187187:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851015.187234:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019656192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851015.187241:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788851015.187284:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b8bcf3480 x1875746019656192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851015.187303:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019656192:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788851015.443671:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851016.469680:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851016.709403:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851016.709444:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851016.709470:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851016.709543:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747136 00000100:00100000:3.0:1788851016.709557:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747136 00000100:00100000:3.0:1788851016.709615:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 232 00000100:00100000:3.0:1788851016.709627:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2352:x1875746000747136:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851016.709705:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2352:x1875746000747136:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 79us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851016.709713:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 232 00000100:00100000:3.0:1788851016.709764:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747264 00000100:00100000:3.0:1788851016.709769:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747264 00000100:00100000:3.0:1788851016.709828:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747392 00000100:00100000:3.0:1788851016.709831:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747392 00000100:00100000:3.0:1788851016.709856:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 92 00000100:00100000:3.0:1788851016.709864:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2352:x1875746000747264:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851016.709898:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2352:x1875746000747264:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 35us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851016.709905:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 92 00000100:00100000:3.0:1788851016.709918:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 93 00000100:00100000:3.0:1788851016.710299:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2351:x1875746000747392:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851016.710331:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2351:x1875746000747392:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 36us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851016.710338:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 93 00000100:00080000:3.0:1788851016.712271:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1788851017.035133:0:11038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788851017.490112:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851018.516269:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851019.538279:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851019.795120:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019656320:0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.795214:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851019.795271:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019656832:0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.795300:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851019.795475:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788851019.795483:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019656448:0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.795510:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851019.795530:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019656960:0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.795557:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851019.795591:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019656576:0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.795617:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851019.795637:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851019.795643:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019656704:0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.795664:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851019.795699:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656320 00000100:00100000:0.0:1788851019.795708:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656320 00000100:00100000:0.0:1788851019.795760:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788851019.795769:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019656320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.795866:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019656320:12345-0@lo:400:kworker.0 Request processed in 98us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851019.795889:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788851019.795931:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656832 00000100:00100000:0.0:1788851019.795935:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656832 00000100:00100000:0.0:1788851019.795979:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656448 00000100:00100000:0.0:1788851019.795982:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656448 00000100:00100000:0.0:1788851019.795994:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656576 00000100:00100000:0.0:1788851019.795997:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656576 00000100:00100000:0.0:1788851019.796012:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788851019.796018:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019656832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.796052:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019656832:12345-0@lo:400:kworker.0 Request processed in 34us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851019.796059:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788851019.796071:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788851019.796077:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019656448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.796105:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019656448:12345-0@lo:400:kworker.0 Request processed in 28us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851019.796111:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788851019.796122:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788851019.796128:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019656576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.796157:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019656576:12345-0@lo:400:kworker.0 Request processed in 29us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851019.796163:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788851019.796182:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656960 00000100:00100000:0.0:1788851019.796185:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656960 00000100:00100000:0.0:1788851019.796211:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019656704 00000100:00100000:0.0:1788851019.796214:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019656704 00000100:00100000:0.0:1788851019.796236:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788851019.796251:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019656960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.796281:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019656960:12345-0@lo:400:kworker.0 Request processed in 32us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851019.796286:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788851019.796298:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788851019.796304:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019656704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.796342:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019656704:12345-0@lo:400:kworker.0 Request processed in 26us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851019.796347:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788851019.796374:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851019.796378:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788851019.796382:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788851019.796423:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b98dac000 x1875746019656704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851019.796439:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019656704:0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.796452:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019656576:0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.796486:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019656448:0@lo:400:kworker.0 00010000:00080000:0.0:1788851019.796495:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b98dadf80 x1875746019656960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851019.796504:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019656960:0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.796513:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019656320:0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.796521:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019656832:0@lo:400:kworker.0 00000100:00100000:0.0:1788851019.799398:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851019.799435:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019657088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851019.799528:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851019.799579:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019657088 00000100:00100000:0.0:1788851019.799588:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019657088 00000100:00100000:0.0:1788851019.799636:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788851019.799644:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019657088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851019.799684:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788851019.799726:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019657088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851019.799733:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788851019.799773:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b98daf480 x1875746019657088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851019.799819:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019657088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851020.307647:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851020.307677:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019657216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851020.307773:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851020.308008:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019657216 00000100:00100000:0.0:1788851020.308021:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019657216 00000100:00100000:0.0:1788851020.308092:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788851020.308104:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019657216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788851020.308273:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788851020.308347:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019657216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 245us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.308355:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788851020.308689:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b8bcf3480 x1875746019657216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851036 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851020.308713:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019657216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788851020.562000:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788851020.937058:0:11187:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee5fe0160 20000000:00000080:2.0:1788851020.937078:0:11187:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a9b98dab000 uarg=0000000000000000 20000000:01000000:2.0:1788851020.937115:0:11187:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788851020.937122:0:11187:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788851020.937126:0:11187:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788851020.938521:0:11188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788851020.938692:0:11187:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788851020.947858:0:11187:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788851020.947894:0:11187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576c2f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851020.947935:0:11187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576bd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9f0 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851020.947944:0:11187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576be2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576bdb expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851020.947961:0:11187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b8168e600/0x7ad3e1a879576bf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576be9 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851020.947969:0:11187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b8168f000/0x7ad3e1a879576bfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576bf7 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851020.947976:0:11187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576c13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea28 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851020.947984:0:11187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576c2f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851020.948031:0:11187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576c13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea28 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851020.948046:0:11187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576c13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea28 expref: 12 pid: 5856 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851020.948062:0:11187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1875746019657344:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851020.948182:0:11187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b8168f000/0x7ad3e1a879576bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576bf7 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851020.948191:0:11187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b8168f000/0x7ad3e1a879576bfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576bf7 expref: 18 pid: 5853 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851020.948207:0:11187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1875746019657472:0@lo:104: 00000100:00100000:2.0:1788851020.948250:0:11187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788851020.948296:0:11187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b8168e600/0x7ad3e1a879576bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576be9 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851020.948305:0:11187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b8168e600/0x7ad3e1a879576bf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576be9 expref: 18 pid: 5853 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851020.948325:0:11187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1875746019657600:0@lo:104: 00000100:00100000:2.0:1788851020.948348:0:11187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788851020.948375:0:11187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576bdb expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851020.948396:0:11187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576be2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576bdb expref: 18 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851020.948404:0:11187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1875746019657728:0@lo:104: 00000100:00100000:2.0:1788851020.948426:0:11187:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788851020.948445:0:11187:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576bd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9f0 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851020.949029:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019657472 00000100:00100000:0.0:1788851020.949038:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019657472 00000100:00100000:0.0:1788851020.949081:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019657600 00000100:00100000:0.0:1788851020.949084:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019657600 00000100:00100000:0.0:1788851020.949095:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019657728 00000100:00100000:0.0:1788851020.949108:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019657728 00000100:00100000:0.0:1788851020.949126:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788851020.949134:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+5:11187:x1875746019657472:12345-0@lo:104: 00010000:00010000:0.0:1788851020.949148:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ee00/0x7ad3e1a879576bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576bfe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.949217:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788851020.949224:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+5:11187:x1875746019657472:12345-0@lo:104: Request processed in 91us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.949230:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788851020.949248:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788851020.949254:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+4:11187:x1875746019657600:12345-0@lo:104: 00010000:00010000:0.0:1788851020.949261:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f800/0x7ad3e1a879576be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576bf0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.949294:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788851020.949299:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+4:11187:x1875746019657600:12345-0@lo:104: Request processed in 47us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.949304:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788851020.949329:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788851020.949335:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+3:11187:x1875746019657728:12345-0@lo:104: 00010000:00010000:0.0:1788851020.949343:0:5844:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f200/0x7ad3e1a879576bdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576be2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.949394:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788851020.949399:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+3:11187:x1875746019657728:12345-0@lo:104: Request processed in 65us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.949405:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788851020.949431:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788851020.949438:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ee00/0x7ad3e1a879576bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576bfe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.949445:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ee00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788851020.949450:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ee00/0x7ad3e1a879576bf7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576bfe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.949459:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ee00/0x7ad3e1a879576bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576bfe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851020.949465:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ee00/0x7ad3e1a879576bf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576bfe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851020.949471:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788851020.949691:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851020.949698:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f800/0x7ad3e1a879576be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576bf0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851020.949706:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f800 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:1.0:1788851020.949709:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f800/0x7ad3e1a879576be9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576bf0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851020.949716:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f800/0x7ad3e1a879576be9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576bf0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851020.949722:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f800/0x7ad3e1a879576be9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576bf0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851020.949728:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788851020.949808:0:11187:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576bd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9f0 expref: 12 pid: 5855 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851020.949821:0:11187:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1875746019657856:192.168.204.6@tcp:104: 00000100:00100000:2.0:1788851020.950088:0:11187:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9a8251f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788851020.950113:0:11187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1875746019657472:0@lo:104: 00000100:00100000:2.0:1788851020.950122:0:11187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1875746019657600:0@lo:104: 00000100:00100000:2.0:1788851020.950143:0:11187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1875746019657728:0@lo:104: 00010000:00010000:0.0:1788851020.950239:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ee00/0x7ad3e1a879576bf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576bfe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.950246:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851020.950265:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ee00/0x7ad3e1a879576bf7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576bfe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.950272:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ee00/0x7ad3e1a879576bf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576bfe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.950285:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851020.950289:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f200/0x7ad3e1a879576bdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576be2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.950295:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f200 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788851020.950298:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f200/0x7ad3e1a879576bdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576be2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.950323:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f200/0x7ad3e1a879576bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576be2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851020.950329:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f200/0x7ad3e1a879576bdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576be2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851020.950335:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788851020.951627:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f800/0x7ad3e1a879576be9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576bf0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851020.951656:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851020.951668:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f800/0x7ad3e1a879576be9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576bf0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851020.951674:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f800/0x7ad3e1a879576be9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576bf0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851020.951689:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851020.951691:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851020.951692:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851020.951880:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019657984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851020.951937:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851020.952045:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851020.952052:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019658112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851020.952076:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788851020.952103:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851020.952117:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019657984 00000100:00100000:1.0:1788851020.952124:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019657984 00010000:00010000:1.0:1788851020.952153:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b8168f000/0x7ad3e1a879576bfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576bf7 expref: 19 pid: 5853 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851020.952179:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019658112 00000100:00100000:1.0:1788851020.952182:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019658112 00010000:00010000:1.0:1788851020.952193:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b8168e600/0x7ad3e1a879576bf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576be9 expref: 20 pid: 5853 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851020.952212:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788851020.952220:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86786850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+20:3310:x1875746019657984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851020.952246:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851020.952252:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b8168f000/0x7ad3e1a879576bfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576bf7 expref: 20 pid: 5853 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851020.952262:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b8168f000/0x7ad3e1a879576bfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576bf7 expref: 20 pid: 5853 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851020.952277:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b8168f000/0x7ad3e1a879576bfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576bf7 expref: 20 pid: 5853 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851020.952290:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851020.952334:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86786850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019657984:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851020.952341:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788851020.952739:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788851020.952748:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:3310:x1875746019658112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851020.952767:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851020.952772:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b8168e600/0x7ad3e1a879576bf0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576be9 expref: 18 pid: 5853 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851020.952802:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b8168e600/0x7ad3e1a879576bf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576be9 expref: 18 pid: 5853 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851020.952814:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b8168e600/0x7ad3e1a879576bf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576be9 expref: 18 pid: 5853 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851020.952823:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851020.952850:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:3310:x1875746019658112:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851020.952866:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788851020.952921:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019658112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851020.952930:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019657984:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851020.953360:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f200/0x7ad3e1a879576bdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576be2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.953369:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851020.953415:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f200/0x7ad3e1a879576bdb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576be2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.953423:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b8168f200/0x7ad3e1a879576bdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576be2 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.953440:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851020.953442:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851020.953452:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851020.953468:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851020.953487:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019658240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851020.953523:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851020.953552:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019658240 00000100:00100000:0.0:1788851020.953557:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019658240 00010000:00010000:0.0:1788851020.953576:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576be2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576bdb expref: 17 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851020.953597:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788851020.953604:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98daca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:3309:x1875746019658240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851020.953624:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851020.953629:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576be2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576bdb expref: 17 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.953636:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576be2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576bdb expref: 17 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.953646:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a4c00/0x7ad3e1a879576be2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576bdb expref: 17 pid: 5855 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.953657:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851020.953684:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98daca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+16:3309:x1875746019658240:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.953689:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788851020.953714:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019658240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851020.960238:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851020.960394:0:11187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1875746019657344:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851020.960398:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747520 00000100:00100000:2.0:1788851020.960409:0:11187:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11187:1875746019657856:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851020.960415:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747520 00010000:00010000:0.0:1788851020.960468:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576c13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea28 expref: 13 pid: 5856 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851020.960476:0:11187:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576c2f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851020.960527:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:0.0:1788851020.960538:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000747520:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851020.960556:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851020.960562:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576c13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea28 expref: 13 pid: 5856 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.960575:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576c13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea28 expref: 13 pid: 5856 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.960614:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af7400/0x7ad3e1a879576c13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea28 expref: 13 pid: 5856 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.960629:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851020.960695:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6835cbef-1345-4ac2-988d-7ad135109255+12:2353:x1875746000747520:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 159us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.960703:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:3.0:1788851020.970349:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851020.970752:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747648 00000100:00100000:0.0:1788851020.970768:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747648 00010000:00010000:0.0:1788851020.971640:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576bd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9f0 expref: 12 pid: 5855 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851020.971691:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00100000:0.0:1788851020.971706:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6835cbef-1345-4ac2-988d-7ad135109255+12:2353:x1875746000747648:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851020.971725:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851020.971732:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576bd4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9f0 expref: 12 pid: 5855 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.971747:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576bd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9f0 expref: 12 pid: 5855 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.971770:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576bd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9f0 expref: 12 pid: 5855 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.974908:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576c2f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.974922:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576c2f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.975703:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576c2f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.975713:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576c2f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.975721:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576c2f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.975728:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576c2f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.975735:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a2200 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851020.975740:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576c2f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.975748:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576c2f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.975776:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576c2f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851020.975876:0:11187:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576c2f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851020.975894:0:11187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576c2f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.977066:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a2200/0x7ad3e1a879576c2f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851020.977098:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851020.977207:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6835cbef-1345-4ac2-988d-7ad135109255+11:2353:x1875746000747648:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 5501us (6868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851020.977219:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 29 00010000:00010000:1.0:1788851021.586007:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851021.825635:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851021.825689:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851021.825983:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747904 00000100:00100000:0.0:1788851021.826014:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747904 00000100:00100000:1.0:1788851021.826135:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000747776 00000100:00100000:1.0:1788851021.826140:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000747776 00000100:00080000:3.0:1788851021.826274:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851021.826427:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 97 00000100:00100000:1.0:1788851021.826441:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000747776:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851021.826541:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000747776:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 104us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851021.826571:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 98 00000100:00100000:0.0:1788851021.826581:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2354:x1875746000747904:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851021.826611:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2354:x1875746000747904:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 33us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851021.826618:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 98 00000100:00100000:1.0:1788851021.826862:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 97 00000100:00100000:2.0:1788851022.148058:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851022.148170:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748032 00000100:00100000:3.0:1788851022.148185:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748032 00000100:00100000:3.0:1788851022.148258:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 234 00000100:00100000:3.0:1788851022.148272:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+11:5606:x1875746000748032:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851022.148303:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851022.148331:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576c36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfea52 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851022.148372:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576c36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea52 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851022.148408:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576c36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea52 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851022.148430:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a5c00, rc 0) 00000100:00100000:3.0:1788851022.148519:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+12:5606:x1875746000748032:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 239us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851022.148526:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 234 00000100:00100000:0.0:1788851022.152049:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851022.153296:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748160 00000100:00100000:3.0:1788851022.153314:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748160 00000100:00100000:3.0:1788851022.153404:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 235 00000100:00100000:3.0:1788851022.153416:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+12:5606:x1875746000748160:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851022.153866:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+12:5606:x1875746000748160:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 450us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851022.153875:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 235 00000100:00100000:3.0:1788851022.159755:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851022.160470:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748288 00000100:00100000:0.0:1788851022.160487:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748288 00000100:00100000:0.0:1788851022.160567:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 236 00000100:00100000:0.0:1788851022.160580:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+12:5606:x1875746000748288:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788851022.160912:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+12:5606:x1875746000748288:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 Request processed in 334us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851022.160921:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 236 00000100:00100000:0.0:1788851022.167747:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851022.168045:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748416 00000100:00100000:2.0:1788851022.168059:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748416 00000100:00100000:2.0:1788851022.168202:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 237 00000100:00100000:2.0:1788851022.168215:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+12:5606:x1875746000748416:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851022.168237:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851022.168259:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a2600/0x7ad3e1a879576c3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfea59 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851022.168305:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a2600/0x7ad3e1a879576c3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea59 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851022.168318:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a2600/0x7ad3e1a879576c3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea59 expref: 13 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851022.168328:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a2600, rc 0) 00000100:00100000:2.0:1788851022.168411:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:5606:x1875746000748416:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 198us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851022.168423:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 237 00000100:00100000:0.0:1788851022.174615:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851022.174971:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748544 00000100:00100000:3.0:1788851022.174985:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748544 00000100:00100000:3.0:1788851022.175054:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 238 00000100:00100000:3.0:1788851022.175066:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:5606:x1875746000748544:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851022.175468:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:5606:x1875746000748544:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 404us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851022.175477:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 238 00000100:00100000:0.0:1788851022.189099:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851022.189948:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748672 00000100:00100000:1.0:1788851022.189964:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748672 00000100:00100000:0.0:1788851022.191632:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 239 00000100:00100000:0.0:1788851022.191716:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:5606:x1875746000748672:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788851022.192208:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:5606:x1875746000748672:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 Request processed in 562us (3133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851022.192417:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 239 00010000:00010000:1.0:1788851022.609914:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788851022.993937:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788851022.993945:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9b866a7000 from 7 10000000:01000000:2.0:1788851022.993950:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788851022.994005:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a2a00/0x7ad3e1a879576c44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851022.994019:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b814a2a00/0x7ad3e1a879576c44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851022.994154:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b814a2a00/0x7ad3e1a879576c44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851022.994183:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019658368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788851022.994256:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851022.995930:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9a8251fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851022.998071:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019658368 00000100:00100000:1.0:1788851022.998087:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019658368 00000100:00100000:3.0:1788851022.998726:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788851022.998738:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019658368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851022.998766:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851022.998823:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a4a00/0x7ad3e1a879576c4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576c44 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851022.999941:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a4a00/0x7ad3e1a879576c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576c44 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851022.999956:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a4a00/0x7ad3e1a879576c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576c44 expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851022.999967:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4a00, rc 0) 00000100:00100000:3.0:1788851023.000077:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019658368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1340us (5820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851023.000086:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788851023.000541:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019658368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851023.000562:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b814a2a00/0x7ad3e1a879576c44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576c4b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851023.000572:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a2a00/0x7ad3e1a879576c44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576c4b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851023.000653:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019658496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851023.000692:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851023.000744:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b9864d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788851023.004029:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019658496 00000100:00100000:3.0:1788851023.004043:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019658496 00000100:00100000:3.0:1788851023.004104:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788851023.004113:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019658496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851023.004441:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019658496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (3747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851023.004449:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788851023.004503:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019658496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851023.004566:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ee1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019658624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851023.004612:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851023.004640:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c093c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851023.004653:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019658624 00000100:00100000:3.0:1788851023.004656:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019658624 00000100:00100000:3.0:1788851023.004685:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788851023.004690:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019658624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851023.004872:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019658624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851023.004878:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788851023.004913:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ee1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019658624:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788851023.010355:0:11285:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788851023.011949:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788851023.011982:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788851023.011994:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a2a00/0x7ad3e1a879576c44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576c4b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851023.012009:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b814a2a00/0x7ad3e1a879576c44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576c4b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851023.012022:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788851023.012025:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9ba049f800 from 7 10000000:01000000:3.0:1788851023.012027:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788851023.012069:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4600/0x7ad3e1a879576c52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851023.012077:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4600/0x7ad3e1a879576c52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851023.012088:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4600/0x7ad3e1a879576c52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851023.012127:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ee1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019658752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788851023.012202:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851023.012281:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c093c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851023.012331:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019658752 00000100:00100000:2.0:1788851023.012339:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019658752 00000100:00100000:2.0:1788851023.012395:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788851023.012406:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019658752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851023.012424:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851023.012438:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576c59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576c52 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851023.012465:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576c59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576c52 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851023.012490:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576c59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576c52 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851023.012499:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a3400, rc 0) 00000100:00100000:2.0:1788851023.012540:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019658752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851023.012547:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788851023.012642:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ee1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019658752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851023.012657:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4600/0x7ad3e1a879576c52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576c59 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851023.012665:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4600/0x7ad3e1a879576c52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576c59 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851023.012715:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ee1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019658880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851023.012741:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851023.012762:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c093c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851023.012824:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019658880 00000100:00100000:2.0:1788851023.012829:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019658880 00000100:00100000:2.0:1788851023.012849:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788851023.012855:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019658880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851023.013115:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019658880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 259us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851023.013122:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788851023.013419:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ee1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019658880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851023.013451:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ee1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019659008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851023.013501:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851023.013530:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c093c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851023.013544:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659008 00000100:00100000:3.0:1788851023.013548:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659008 00000100:00100000:3.0:1788851023.013573:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788851023.013580:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019659008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851023.013740:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019659008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851023.013747:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788851023.013811:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ee1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019659008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788851023.016026:0:11286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788851023.016231:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788851023.016250:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788851023.016261:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4600/0x7ad3e1a879576c52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576c59 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851023.016284:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4600/0x7ad3e1a879576c52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576c59 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851023.016295:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788851023.016298:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9ba0462000 from 7 10000000:01000000:2.0:1788851023.016301:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788851023.016519:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3e00/0x7ad3e1a879576c60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851023.016545:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3e00/0x7ad3e1a879576c60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851023.016557:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3e00/0x7ad3e1a879576c60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851023.016583:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019659136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788851023.016642:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851023.016729:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b94de7840 going to sleep for 11 seconds 00000100:00100000:3.0:1788851023.016993:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659136 00000100:00100000:3.0:1788851023.017001:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659136 00000100:00100000:3.0:1788851023.017189:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788851023.017199:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019659136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851023.017213:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851023.017228:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576c67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576c60 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851023.017253:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576c67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576c60 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851023.017264:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576c67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576c60 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851023.017284:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a5400, rc 0) 00000100:00100000:3.0:1788851023.017342:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019659136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851023.017349:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788851023.017430:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019659136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851023.017446:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3e00/0x7ad3e1a879576c60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576c67 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851023.017455:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3e00/0x7ad3e1a879576c60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576c67 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851023.017519:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019659264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851023.017552:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851023.018002:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b9864d180 going to sleep for 11 seconds 00000100:00100000:2.0:1788851023.018039:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659264 00000100:00100000:2.0:1788851023.018045:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659264 00000100:00100000:2.0:1788851023.018072:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788851023.018079:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019659264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851023.018684:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019659264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 603us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851023.018692:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788851023.019042:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019659264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851023.019086:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019659392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851023.019144:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851023.019178:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b9864d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788851023.019298:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659392 00000100:00100000:3.0:1788851023.019304:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659392 00000100:00100000:3.0:1788851023.019350:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788851023.019358:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019659392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851023.019543:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019659392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851023.019550:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788851023.019586:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019659392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788851023.023649:0:11287:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788851023.025297:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788851023.025337:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788851023.025349:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3e00/0x7ad3e1a879576c60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576c67 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851023.025372:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3e00/0x7ad3e1a879576c60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576c67 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851023.634438:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851024.659052:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788851024.904148:0:11386:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788851024.914045:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019659520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851024.914144:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851024.914414:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019659904:0@lo:400:kworker.0 00000100:00100000:1.0:1788851024.914453:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851024.914480:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851024.914486:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019660032:0@lo:400:kworker.0 00000100:00100000:1.0:1788851024.914512:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851024.914548:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659520 00000100:00100000:1.0:1788851024.914559:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659520 00000100:00100000:1.0:1788851024.914635:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788851024.914646:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98daed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019659520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788851024.914717:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851024.914765:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98daed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019659520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851024.914772:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788851024.914826:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019659776:0@lo:400:kworker.0 00000100:00100000:1.0:1788851024.914852:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851024.914873:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788851024.914879:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019659648:0@lo:400:kworker.0 00000100:00100000:1.0:1788851024.914907:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851024.914931:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019660160:0@lo:400:kworker.0 00000100:00100000:1.0:1788851024.914954:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851024.914980:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659904 00000100:00100000:1.0:1788851024.914984:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659904 00000100:00100000:1.0:1788851024.915020:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659776 00000100:00100000:1.0:1788851024.915023:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659776 00000100:00100000:1.0:1788851024.915035:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660160 00000100:00100000:1.0:1788851024.915037:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660160 00000100:00100000:1.0:1788851024.915051:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788851024.915057:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019659904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851024.915095:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019659904:12345-0@lo:400:kworker.0 Request processed in 38us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851024.915101:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788851024.915115:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788851024.915121:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019659776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851024.915152:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019659776:12345-0@lo:400:kworker.0 Request processed in 31us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851024.915166:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788851024.915178:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788851024.915184:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019660160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851024.915211:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019660160:12345-0@lo:400:kworker.0 Request processed in 28us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851024.915217:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788851024.915245:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660032 00000100:00100000:1.0:1788851024.915250:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660032 00000100:00100000:1.0:1788851024.915278:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788851024.915283:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019660032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851024.915311:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019660032:12345-0@lo:400:kworker.0 Request processed in 28us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851024.915316:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788851024.915334:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788851024.915339:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851024.915341:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851024.915358:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019659648 00000100:00100000:1.0:1788851024.915361:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019659648 00000100:00100000:1.0:1788851024.915385:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788851024.915391:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019659648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851024.915421:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019659648:12345-0@lo:400:kworker.0 Request processed in 30us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851024.915427:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00080000:1.0:1788851024.915491:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b8bcf0a80 x1875746019660032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851024.915509:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019660032:0@lo:400:kworker.0 00000100:00100000:1.0:1788851024.915531:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019659904:0@lo:400:kworker.0 00000100:00100000:1.0:1788851024.915560:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019659648:0@lo:400:kworker.0 00000100:00100000:1.0:1788851024.915569:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019660160:0@lo:400:kworker.0 00000100:00100000:1.0:1788851024.915577:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019659776:0@lo:400:kworker.0 00010000:00080000:1.0:1788851024.915604:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b98dadf80 x1875746019659520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851024.915620:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019659520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851025.427489:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788851025.427526:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019660288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851025.427615:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851025.428259:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660288 00000100:00100000:1.0:1788851025.428274:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660288 00000100:00100000:1.0:1788851025.428360:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788851025.428371:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019660288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851025.428419:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851025.429363:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019660288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 988us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851025.429376:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788851025.429733:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b87ca4380 x1875746019660288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851041 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851025.429760:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019660288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788851025.682436:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851026.706349:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851026.945663:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851026.945712:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851026.945746:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851026.945802:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000749056 00000100:00100000:2.0:1788851026.945811:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748800 00000100:00100000:0.0:1788851026.945814:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000749056 00000100:00100000:2.0:1788851026.945815:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748800 00000100:00100000:0.0:1788851026.945864:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000748928 00000100:00100000:0.0:1788851026.945867:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000748928 00000100:00100000:2.0:1788851026.945870:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 250 00000100:00100000:2.0:1788851026.945881:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:2351:x1875746000748800:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851026.945887:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 102 00000100:00100000:0.0:1788851026.945893:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+5:2351:x1875746000749056:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788851026.945962:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:2351:x1875746000748800:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 82us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851026.945969:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 250 00000100:00100000:3.0:1788851026.947004:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 103 00000100:00100000:3.0:1788851026.947032:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2351:x1875746000748928:12345-192.168.204.6@tcp:400:kworker.0 00000100:00080000:2.0:1788851026.947976:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851026.950458:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+5:2351:x1875746000749056:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 4545us (4726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851026.950475:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 102 00000100:00100000:3.0:1788851026.950949:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98daf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2351:x1875746000748928:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 3928us (5196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851026.950960:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 103 00010000:00010000:1.0:1788851027.730764:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851028.754580:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788851028.804926:0:11485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 03:03:46 (1788851026) === 00000100:00100000:0.0:1788851029.062028:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851029.062169:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851029.062221:0:5870:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000749312 00000100:00100000:3.0:1788851029.062236:0:5870:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000749312 00000100:00080000:0.0:1788851029.062403:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851029.062549:0:5870:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:3.0:1788851029.062564:0:5870:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:9719:x1875746000749312:12345-192.168.204.6@tcp:700:mkdir.0 00000100:00100000:1.0:1788851029.062721:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000749184 00000100:00100000:1.0:1788851029.062726:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000749184 00000100:00100000:1.0:1788851029.062774:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:1.0:1788851029.062817:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2352:x1875746000749184:12345-192.168.204.6@tcp:41:mkdir.0 00000004:00000024:1.0:1788851029.062857:0:5861:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788851029.065411:0:5870:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:9719:x1875746000749312:12345-192.168.204.6@tcp:700:mkdir.0 Request processed in 2830us (3220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851029.065431:0:5870:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:1.0:1788851029.066183:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2352:x1875746000749184:12345-192.168.204.6@tcp:41:mkdir.0 Request processed in 3397us (4165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851029.066208:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:3.0:1788851029.073378:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851029.074268:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000749568 00000100:00100000:0.0:1788851029.074283:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000749568 00000100:00100000:0.0:1788851029.074367:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:0.0:1788851029.074379:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:9719:x1875746000749568:12345-192.168.204.6@tcp:36:mkdir.0 00010000:00010000:0.0:1788851029.074473:0:8079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851029.075738:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b80030a00/0x7ad3e1a879576b4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9db expref: 6 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.076057:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b87c2ac00) 00010000:00010000:0.0:1788851029.076072:0:8079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851029.076424:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576c6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.076440:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576c6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.076452:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576c6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.076481:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879576c75 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.076488:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879576c75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.076494:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879576c75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851029.078511:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788851029.078533:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576c6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.078543:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576c6e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.078551:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576c6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.078566:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851029.078571:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576c6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.078579:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576c6e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.078598:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851029.078601:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851029.078608:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576c6e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.078615:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576c6e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851029.078639:0:8079:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000363f9ca0 reply state 000000006a13c83c transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879576c75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851029.078648:0:8079:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788851029.079049:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:9719:x1875746000749568:12345-192.168.204.6@tcp:36:mkdir.0 Request processed in 4390us (5401us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788851029.079061:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00010000:00010000:2.0:1788851029.086119:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879576c75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.086168:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879576c75 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.086177:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879576c75 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.086184:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851029.086190:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879576c75 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.086199:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879576c75 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.086228:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a9ba0794000) 00010000:00010000:2.0:1788851029.086232:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851029.086239:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879576c75 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.086247:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879576c75 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851029.095561:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851029.095755:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000749696 00000100:00100000:0.0:1788851029.095769:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000749696 00000100:00100000:0.0:1788851029.095891:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:0.0:1788851029.095904:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:9720:x1875746000749696:12345-192.168.204.6@tcp:101:chmod.0 00010000:00010000:0.0:1788851029.095931:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851029.095961:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576c7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfea60 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.096093:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576c83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.096109:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.096123:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851029.096177:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788851029.096182:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788851029.096232:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576c83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.096267:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576c7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea60 expref: 8 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.096287:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576c83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea60 expref: 7 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.096297:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851029.096300:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851029.096304:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7400, rc 0) 00000100:00100000:0.0:1788851029.096381:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:9720:x1875746000749696:12345-192.168.204.6@tcp:101:chmod.0 Request processed in 479us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851029.096390:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:3.0:1788851029.104872:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851029.105051:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000749952 00000100:00100000:0.0:1788851029.105065:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000749952 00000100:00100000:0.0:1788851029.105168:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:0.0:1788851029.105181:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:9720:x1875746000749952:12345-192.168.204.6@tcp:36:chmod.0 00010000:00010000:0.0:1788851029.105252:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851029.105286:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576c83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea60 expref: 7 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.105309:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851029.105321:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851029.105352:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879576c8a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.105366:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879576c8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.105377:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879576c8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851029.105758:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030b13c1a reply state 000000005f3538fd transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879576c8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851029.105769:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788851029.105830:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788851029.105931:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:9720:x1875746000749952:12345-192.168.204.6@tcp:36:chmod.0 Request processed in 752us (1073us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788851029.105939:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 17 00010000:00010000:3.0:1788851029.112428:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879576c8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.112449:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879576c8a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.112477:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879576c8a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.112484:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851029.112488:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879576c8a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.112496:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879576c8a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.112516:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9ba0794f00) 00010000:00010000:3.0:1788851029.112519:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788851029.112525:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879576c8a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.112532:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879576c8a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851029.134421:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851029.134831:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000750080 00000100:00100000:1.0:1788851029.134842:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000750080 00000100:00100000:1.0:1788851029.135159:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:1.0:1788851029.135172:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:9721:x1875746000750080:12345-192.168.204.6@tcp:101:chown.0 00010000:00010000:1.0:1788851029.135278:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851029.135309:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576c91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfea67 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.135381:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576c98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.135396:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576c98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.135410:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576c98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851029.135449:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788851029.135453:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788851029.135493:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576c98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.136833:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576c91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea67 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.136868:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576c98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea67 expref: 8 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.136903:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b9199a800) 00010000:00010000:1.0:1788851029.136907:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788851029.137270:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58c00, rc 0) 00000100:00100000:1.0:1788851029.137422:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:9721:x1875746000750080:12345-192.168.204.6@tcp:101:chown.0 Request processed in 2252us (3010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851029.137432:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:1.0:1788851029.146537:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851029.147103:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000750208 00000100:00100000:0.0:1788851029.147115:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000750208 00000100:00100000:0.0:1788851029.147195:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:0.0:1788851029.147207:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:9721:x1875746000750208:12345-192.168.204.6@tcp:101:chown.0 00010000:00010000:0.0:1788851029.147252:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851029.147275:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576c9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfea6e expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147346:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576ca6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147363:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147377:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147393:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147401:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147408:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147512:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576cb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147520:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147527:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851029.147560:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788851029.147570:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788851029.147596:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147611:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576ca6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147618:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576ca6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147627:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147633:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851029.147638:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576ca6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147646:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576ca6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147659:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b9199a800) 00010000:00010000:0.0:1788851029.147662:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851029.147668:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576ca6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147675:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576ca6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147689:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147694:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147710:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147715:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851029.147718:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147724:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147732:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851029.147735:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851029.147738:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147744:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147777:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576c9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea6e expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147852:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea6e expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.147860:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a9ba0794800) 00010000:00010000:0.0:1788851029.147862:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851029.147864:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6000, rc 0) 00000100:00100000:0.0:1788851029.147944:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:9721:x1875746000750208:12345-192.168.204.6@tcp:101:chown.0 Request processed in 739us (1420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851029.147961:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:2.0:1788851029.152923:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851029.153778:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000750464 00000100:00100000:0.0:1788851029.153811:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000750464 00000100:00100000:0.0:1788851029.153887:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:0.0:1788851029.153898:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:9721:x1875746000750464:12345-192.168.204.6@tcp:36:chown.0 00010000:00010000:0.0:1788851029.154253:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851029.154286:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576cb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea6e expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.154307:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a9ba0794800) 00010000:00010000:0.0:1788851029.154318:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851029.154347:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.154362:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.154372:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851029.207027:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af5975eb reply state 000000005cd1a082 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851029.207053:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788851029.207073:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788851029.207227:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+10:9721:x1875746000750464:12345-192.168.204.6@tcp:36:chown.0 Request processed in 53324us (54313us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788851029.207237:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 20 00000001:00080000:3.0:1788851029.207456:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:1.0:1788851029.207523:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.207533:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.207541:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.207547:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851029.207552:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.207582:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.207613:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:1.0:1788851029.207617:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788851029.207623:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.207638:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576cbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851029.227642:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851029.228132:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000750592 00000100:00100000:0.0:1788851029.228155:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000750592 00000100:00100000:0.0:1788851029.228233:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:0.0:1788851029.228244:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:9722:x1875746000750592:12345-192.168.204.6@tcp:101:touch.500 00010000:00010000:0.0:1788851029.228275:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851029.228315:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576cc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfea75 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788851029.235269:0:5862:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 6660us 00010000:00010000:1.0:1788851029.249216:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576cc9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.249248:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.249261:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.249278:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59200/0x7ad3e1a879576cd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.249285:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59200/0x7ad3e1a879576cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.249291:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59200/0x7ad3e1a879576cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.251161:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879576cd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.251194:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879576cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.251207:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879576cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851029.251248:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788851029.251253:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788851029.251310:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879576cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.251326:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576cc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.252229:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576cc9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.252237:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.252243:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851029.252248:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576cc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.252257:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576cc9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.252275:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b9199a800) 00010000:00010000:1.0:1788851029.252722:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851029.252732:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576cc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.252751:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576cc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.252769:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59200/0x7ad3e1a879576cd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.252776:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59200/0x7ad3e1a879576cd0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.252968:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59200/0x7ad3e1a879576cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.252975:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851029.252979:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59200/0x7ad3e1a879576cd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.252986:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59200/0x7ad3e1a879576cd0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.252998:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a9b9199a600) 00010000:00010000:1.0:1788851029.253001:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851029.253005:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59200/0x7ad3e1a879576cd0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.253011:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59200/0x7ad3e1a879576cd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.253076:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576cc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea75 expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.253096:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879576cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea75 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.253112:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a9b9199af00) 00010000:00010000:1.0:1788851029.253115:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788851029.253118:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58a00, rc 0) 00000100:00100000:1.0:1788851029.254534:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:9722:x1875746000750592:12345-192.168.204.6@tcp:101:touch.500 Request processed in 26280us (26903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851029.254549:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:1.0:1788851029.260219:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851029.260442:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000750848 00000100:00100000:2.0:1788851029.260456:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000750848 00000100:00100000:2.0:1788851029.260562:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:2.0:1788851029.260575:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:9722:x1875746000750848:12345-192.168.204.6@tcp:101:touch.500 00010000:00010000:2.0:1788851029.260608:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851029.260644:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a3c00/0x7ad3e1a879576cde lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfea7c expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.261245:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2c00/0x7ad3e1a879576ce5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.261264:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2c00/0x7ad3e1a879576ce5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.261278:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2c00/0x7ad3e1a879576ce5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.261306:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2200/0x7ad3e1a879576cec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.261314:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2200/0x7ad3e1a879576cec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.261321:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2200/0x7ad3e1a879576cec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788851029.263258:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788851029.264138:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879576cf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.264172:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879576cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.264188:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879576cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.264236:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2c00/0x7ad3e1a879576ce5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.264254:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2c00/0x7ad3e1a879576ce5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.264261:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2c00/0x7ad3e1a879576ce5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.264267:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a2c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851029.264273:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2c00/0x7ad3e1a879576ce5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.264282:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2c00/0x7ad3e1a879576ce5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.264297:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a9b9199af00) 00010000:00010000:2.0:1788851029.264300:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851029.264306:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2c00/0x7ad3e1a879576ce5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.264312:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2c00/0x7ad3e1a879576ce5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788851029.264328:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025561162 reply state 0000000011f7b3de transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2200/0x7ad3e1a879576cec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851029.264476:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788851029.264526:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a3c00/0x7ad3e1a879576cde lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea7c expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.264542:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879576cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea7c expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851029.264562:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a9bbcd02500) 00010000:00010000:2.0:1788851029.264565:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851029.264568:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546400, rc 0) 00000100:00100000:2.0:1788851029.267710:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+10:9722:x1875746000750848:12345-192.168.204.6@tcp:101:touch.500 Request processed in 7118us (7485us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788851029.267735:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:2.0:1788851029.273477:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00010000:00010000:1.0:1788851029.273555:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2200/0x7ad3e1a879576cec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.273569:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2200/0x7ad3e1a879576cec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.273578:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2200/0x7ad3e1a879576cec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.273584:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a2200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851029.273589:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2200/0x7ad3e1a879576cec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.273599:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2200/0x7ad3e1a879576cec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.273636:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x74bc947d (ffff8a9bbcd02400) 00010000:00010000:1.0:1788851029.273639:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851029.273644:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2200/0x7ad3e1a879576cec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.273650:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a2200/0x7ad3e1a879576cec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851029.274079:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000751104 00000100:00100000:0.0:1788851029.274095:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000751104 00000100:00100000:0.0:1788851029.274171:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:0.0:1788851029.274184:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:9722:x1875746000751104:12345-192.168.204.6@tcp:36:touch.500 00010000:00010000:0.0:1788851029.274260:0:8079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851029.274293:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879576cf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea7c expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.274306:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a9bbcd02500) 00010000:00010000:0.0:1788851029.274314:0:8079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851029.274370:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576d01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.274386:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.274397:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851029.274572:0:8079:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001967295c reply state 0000000099c53ee3 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851029.274583:0:8079:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788851029.274716:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+10:9722:x1875746000751104:12345-192.168.204.6@tcp:36:touch.500 Request processed in 535us (1256us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788851029.274725:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 23 00010000:00010000:3.0:1788851029.280437:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.280463:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576d01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.280473:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576d01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.280480:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851029.280486:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576d01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.280516:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576d01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.280535:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a9ba0794000) 00010000:00010000:3.0:1788851029.280538:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851029.280544:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576d01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.280549:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576d01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851029.282509:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851029.282622:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000751232 00000100:00100000:1.0:1788851029.282652:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000751232 00000100:00100000:1.0:1788851029.282727:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:1.0:1788851029.282739:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:9722:x1875746000751232:12345-192.168.204.6@tcp:101:touch.500 00010000:00010000:1.0:1788851029.282768:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851029.282827:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59200/0x7ad3e1a879576d08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfea83 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.282907:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59200/0x7ad3e1a879576d08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea83 expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.282924:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59200/0x7ad3e1a879576d08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea83 expref: 10 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.282946:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a9b9199a600) 00010000:00010000:1.0:1788851029.282949:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788851029.282954:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59200, rc 0) 00000100:00100000:1.0:1788851029.283024:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+10:9722:x1875746000751232:12345-192.168.204.6@tcp:101:touch.500 Request processed in 287us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851029.283032:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:0.0:1788851029.291689:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851029.291911:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000751360 00000100:00100000:1.0:1788851029.291925:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000751360 00000100:00100000:1.0:1788851029.291988:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:1.0:1788851029.291999:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2350:x1875746000751360:12345-192.168.204.6@tcp:8:touch.500 00010000:00080000:1.0:1788851029.292045:0:8281:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp t0 exp 0000000000000000 cur 362 last 0 00000020:00000080:1.0:1788851029.292089:0:8281:0:(genops.c:1384:class_connect()) connect: client 3c328062-9d4c-41e6-ae57-f4af3bf37898, cookie 0x7ad3e1a879576d0f 00002000:00100000:1.0:1788851029.292119:0:8281:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3c328062-9d4c-41e6-ae57-f4af3bf37898/ffff8a9bc1e00000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788851029.292159:0:8281:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788851029.292572:0:8281:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788851029.292614:0:8281:0:(import.c:65:import_set_state_nolock()) ffff8a9bc1e05000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851029.293229:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2350:x1875746000751360:12345-192.168.204.6@tcp:8:touch.500 Request processed in 1225us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851029.293241:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:3.0:1788851029.296999:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851029.297156:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000751488 00000100:00100000:1.0:1788851029.297169:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000751488 00000100:00100000:1.0:1788851029.297323:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:1.0:1788851029.297456:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:0:x1875746000751488:12345-192.168.204.6@tcp:2:touch.500 00000100:00080000:0.0:1788851029.298499:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788851029.334946:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1788851029.334973:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c328062-9d4c-41e6-ae57-f4af3bf37898 00000100:00100000:1.0:1788851029.335530:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:0:x1875746000751488:12345-192.168.204.6@tcp:2:touch.500 Request processed in 38186us (38535us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788851029.335546:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:2.0:1788851029.338726:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851029.339501:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000751744 00000100:00100000:0.0:1788851029.339516:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000751744 00000100:00100000:0.0:1788851029.339764:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:0.0:1788851029.339777:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+10:9722:x1875746000751744:12345-192.168.204.6@tcp:35:touch.500 00000100:00100000:0.0:1788851029.340298:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+11:9722:x1875746000751744:12345-192.168.204.6@tcp:35:touch.500 Request processed in 521us (1702us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788851029.340308:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:2.0:1788851029.354295:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851029.354906:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000751872 00000100:00100000:1.0:1788851029.354920:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000751872 00000100:00100000:1.0:1788851029.355039:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:1.0:1788851029.355052:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+11:9723:x1875746000751872:12345-192.168.204.6@tcp:101:rm.0 00010000:00010000:1.0:1788851029.355247:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851029.355277:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576d16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfea8a expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.355487:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a879576d1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.355504:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a879576d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.355541:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a879576d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851029.355586:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788851029.355590:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788851029.355812:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a879576d1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.355851:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576d16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea8a expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.355875:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a879576d1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea8a expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.355885:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a9b9199af00) 00010000:00010000:1.0:1788851029.355888:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788851029.355893:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59000, rc 0) 00000100:00100000:1.0:1788851029.355979:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+12:9723:x1875746000751872:12345-192.168.204.6@tcp:101:rm.0 Request processed in 930us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851029.355988:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:3.0:1788851029.361614:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851029.362027:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000752128 00000100:00100000:1.0:1788851029.362041:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000752128 00000100:00100000:1.0:1788851029.362119:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 26 00000100:00100000:1.0:1788851029.362131:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+12:9723:x1875746000752128:12345-192.168.204.6@tcp:101:rm.0 00010000:00010000:1.0:1788851029.362171:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851029.362199:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576d24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfea91 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851029.362361:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788851029.362555:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576d24 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea91 expref: 14 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.362571:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b9199a800) 00010000:00010000:1.0:1788851029.362574:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788851029.362580:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576d24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea91 expref: 14 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.362597:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59a00, rc 0) 00000100:00100000:1.0:1788851029.362970:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:9723:x1875746000752128:12345-192.168.204.6@tcp:101:rm.0 Request processed in 840us (1382us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788851029.362978:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 26 00000100:00100000:2.0:1788851029.369164:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851029.369349:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000752256 00000100:00100000:1.0:1788851029.369363:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000752256 00000100:00100000:1.0:1788851029.369425:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:1.0:1788851029.369437:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:9723:x1875746000752256:12345-192.168.204.6@tcp:37:rm.0 00000100:00100000:1.0:1788851029.378057:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:9723:x1875746000752256:12345-192.168.204.6@tcp:37:rm.0 Request processed in 8604us (8900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851029.378073:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:3.0:1788851029.382269:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851029.382496:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000752512 00000100:00100000:0.0:1788851029.382509:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000752512 00000100:00100000:0.0:1788851029.382742:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:0.0:1788851029.382755:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b912ad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:9723:x1875746000752512:12345-192.168.204.6@tcp:35:rm.0 00000100:00100000:0.0:1788851029.383111:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b912ad850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:9723:x1875746000752512:12345-192.168.204.6@tcp:35:rm.0 Request processed in 357us (854us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788851029.383119:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:2.0:1788851029.386300:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851029.386437:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000752768 00000100:00100000:3.0:1788851029.386450:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000752768 00000100:00100000:3.0:1788851029.386524:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:3.0:1788851029.386537:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:9723:x1875746000752768:12345-192.168.204.6@tcp:101:rm.0 00010000:00010000:3.0:1788851029.386569:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851029.386607:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576d32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfea98 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.386740:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576d39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.386755:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576d39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.386821:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576d39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851029.386838:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788851029.387042:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576d32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea98 expref: 17 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.387066:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576d39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea98 expref: 16 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.387075:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a9b9199af00) 00010000:00010000:3.0:1788851029.387078:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788851029.387082:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168e600, rc 0) 00000100:00100000:3.0:1788851029.387909:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+16:9723:x1875746000752768:12345-192.168.204.6@tcp:101:rm.0 Request processed in 1368us (1626us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788851029.387922:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:3.0:1788851029.391850:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851029.392382:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000752896 00000100:00100000:1.0:1788851029.392397:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000752896 00000100:00100000:1.0:1788851029.392475:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:1.0:1788851029.392488:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+16:9723:x1875746000752896:12345-192.168.204.6@tcp:41:rm.0 00000004:00000024:1.0:1788851029.392564:0:5863:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1788851029.392891:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+16:9723:x1875746000752896:12345-192.168.204.6@tcp:41:rm.0 Request processed in 404us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851029.392900:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:1.0:1788851029.397487:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851029.397580:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000753024 00000100:00100000:3.0:1788851029.397593:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000753024 00000100:00100000:3.0:1788851029.397674:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00100000:3.0:1788851029.397687:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+16:9723:x1875746000753024:12345-192.168.204.6@tcp:101:rm.0 00010000:00010000:3.0:1788851029.397712:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851029.397738:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879576d47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfea9f expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.397869:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576d4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.397908:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.397922:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.397941:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576d55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.397949:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.397956:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398084:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576d5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398093:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398099:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851029.398134:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788851029.398139:0:8079:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788851029.398174:0:8079:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398188:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398208:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576d4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398215:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576d4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398221:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576d4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398226:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851029.398231:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576d4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398238:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576d4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398252:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a9b9199af00) 00010000:00010000:3.0:1788851029.398255:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851029.398259:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576d4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398265:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576d4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398277:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576d55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398293:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576d55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398298:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398310:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ee00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851029.398313:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576d55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398319:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576d55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398337:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x74bc947d (ffff8a9b87c2a700) 00010000:00010000:3.0:1788851029.398341:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851029.398344:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576d55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398351:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576d55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398388:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879576d47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea9f expref: 18 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398403:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576d5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea9f expref: 17 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.398411:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a9b9199a600) 00010000:00010000:3.0:1788851029.398414:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851029.398416:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f800, rc 0) 00000100:00100000:3.0:1788851029.398494:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:9723:x1875746000753024:12345-192.168.204.6@tcp:101:rm.0 Request processed in 810us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851029.398503:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00100000:3.0:1788851029.402322:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851029.404216:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000753280 00000100:00100000:1.0:1788851029.404235:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000753280 00000100:00100000:1.0:1788851029.404481:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 30 00000100:00100000:1.0:1788851029.404495:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:9723:x1875746000753280:12345-192.168.204.6@tcp:36:rm.0 00010000:00010000:1.0:1788851029.404567:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788851029.404611:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576d5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea9f expref: 17 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.404663:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59200/0x7ad3e1a879576d08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea83 expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.404677:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a9b9199a600) 00010000:00010000:1.0:1788851029.404695:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a879576d1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea8a expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.404704:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a9b9199af00) 00010000:00010000:1.0:1788851029.404707:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851029.404733:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576d63 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.404749:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576d63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.404761:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576d63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.404829:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576d6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.404838:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576d6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.404845:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576d6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.404982:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576d71 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.404990:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576d71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.404997:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576d71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851029.407596:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788851029.407613:0:5863:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362348831046ns, next at 363348827230ns, rc = 0 00010000:00010000:1.0:1788851029.407700:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879576d78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.407718:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879576d78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.407732:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879576d78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.407740:0:5863:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879576d78 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.407759:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879576d78 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.407766:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879576d78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.407938:0:5863:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851029.407967:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576d71 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.407973:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576d71 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.407979:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576d71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.407985:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851029.407990:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576d71 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.407997:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576d71 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.408009:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a9b9199a400) 00010000:00010000:1.0:1788851029.408012:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788851029.408017:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576d71 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.408023:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576d71 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.408046:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576d63 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.408058:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576d63 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.408063:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576d63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.408067:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851029.408070:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576d63 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.408076:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576d63 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.408084:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a9b9199af00) 00010000:00010000:1.0:1788851029.408086:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851029.408089:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576d63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.408094:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879576d63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851029.408104:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000047219dbd reply state 00000000fc4b462d transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576d6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851029.408113:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788851029.408246:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+16:9723:x1875746000753280:12345-192.168.204.6@tcp:36:rm.0 Request processed in 3749us (5935us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788851029.408254:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 30 00010000:00010000:0.0:1788851029.408617:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851029.408625:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879576d78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.408633:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59800 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851029.408637:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879576d78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.408645:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879576d78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.408655:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8a9b9199a400) 00010000:00010000:0.0:1788851029.408667:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788851029.408671:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879576d78 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.408677:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879576d78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851029.408698:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851029.408700:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851029.408701:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851029.412556:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851029.412720:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000753536 00000100:00100000:2.0:1788851029.412734:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000753536 00000100:00100000:2.0:1788851029.412926:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:2.0:1788851029.412939:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+16:9723:x1875746000753536:12345-192.168.204.6@tcp:35:rm.0 00000100:00100000:2.0:1788851029.413289:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:9723:x1875746000753536:12345-192.168.204.6@tcp:35:rm.0 Request processed in 342us (737us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788851029.413299:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 5 00010000:00010000:1.0:1788851029.413922:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576d6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.413957:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576d6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.413965:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576d6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.413971:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851029.413977:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576d6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.413985:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576d6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.414003:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x74bc947d (ffff8a9b9199a700) 00010000:00010000:1.0:1788851029.414006:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851029.414011:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576d6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.414018:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576d6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851029.416275:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851029.416435:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000753792 00000100:00100000:1.0:1788851029.416448:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000753792 00000100:00100000:1.0:1788851029.416520:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:1.0:1788851029.416532:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+16:9723:x1875746000753792:12345-192.168.204.6@tcp:36:rm.0 00010000:00010000:1.0:1788851029.416640:0:8079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788851029.416673:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576d39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea98 expref: 16 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.416715:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879576cd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea75 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.416729:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a9b9199af00) 00010000:00010000:1.0:1788851029.416747:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576c98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea67 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.416756:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b9199a800) 00010000:00010000:1.0:1788851029.416763:0:8079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851029.416815:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879576d7f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.416829:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879576d7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.416839:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879576d7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.416852:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879576d86 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.416859:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879576d86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.416865:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879576d86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417154:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879576d8d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417171:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879576d8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417179:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879576d8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851029.417844:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788851029.417866:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879576d8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417873:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879576d8d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417880:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879576d8d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417886:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851029.417891:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879576d8d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417900:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879576d8d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417910:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8a9b9199ad00) 00010000:00010000:1.0:1788851029.417914:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788851029.417918:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879576d8d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417924:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879576d8d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417947:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879576d7f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417959:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879576d7f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417965:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879576d7f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417970:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851029.417973:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879576d7f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417979:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879576d7f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417986:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b9199ac00) 00010000:00010000:1.0:1788851029.417988:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851029.417991:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879576d7f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.417996:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879576d7f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851029.418007:0:8079:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002718a4a0 reply state 000000002e3c2ede transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879576d86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851029.418016:0:8079:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788851029.418111:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+15:9723:x1875746000753792:12345-192.168.204.6@tcp:36:rm.0 Request processed in 1579us (1849us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788851029.418119:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 31 00010000:00010000:3.0:1788851029.423827:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879576d86 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.423853:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879576d86 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.423862:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879576d86 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.423868:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851029.423874:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879576d86 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.423882:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879576d86 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.423902:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8a9b9199aa00) 00010000:00010000:3.0:1788851029.423905:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851029.423911:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879576d86 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851029.423917:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879576d86 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851029.778007:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851030.034084:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019660416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851030.034183:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.034283:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660416 00000100:00100000:2.0:1788851030.034293:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660416 00000100:00100000:2.0:1788851030.034369:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788851030.034379:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019660416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851030.034422:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788851030.034489:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4131f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019660416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.034496:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788851030.034520:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788851030.034559:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bafcf3800 x1875746019660416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851030.034580:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019660416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851030.034733:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019660672:0@lo:400:kworker.0 00000100:00100000:3.0:1788851030.034770:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851030.034820:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851030.034826:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019660800:0@lo:400:kworker.0 00000100:00100000:3.0:1788851030.034849:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.035104:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019660544:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.035151:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.035178:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019661056:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.035200:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.035220:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851030.035227:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019660928:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.035248:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851030.035290:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660544 00000100:00100000:2.0:1788851030.035295:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660544 00000100:00100000:2.0:1788851030.035329:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788851030.035337:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019660544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.035376:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019660544:12345-0@lo:400:kworker.0 Request processed in 40us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.035383:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788851030.035411:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660672 00000100:00100000:2.0:1788851030.035415:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660672 00000100:00100000:2.0:1788851030.035444:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660800 00000100:00100000:2.0:1788851030.035464:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660800 00000100:00100000:2.0:1788851030.035497:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019661056 00000100:00100000:2.0:1788851030.035501:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019661056 00000100:00100000:2.0:1788851030.035517:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788851030.035523:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019660672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.035566:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019660672:12345-0@lo:400:kworker.0 Request processed in 44us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.035573:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788851030.035586:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788851030.035592:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019660800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.035621:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019660800:12345-0@lo:400:kworker.0 Request processed in 29us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.035626:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788851030.035639:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788851030.035645:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019661056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.035672:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019661056:12345-0@lo:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.035677:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788851030.035697:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019660928 00000100:00100000:2.0:1788851030.035701:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019660928 00000100:00100000:2.0:1788851030.035732:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788851030.035738:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019660928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.035769:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019660928:12345-0@lo:400:kworker.0 Request processed in 31us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851030.035775:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788851030.035824:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788851030.035828:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851030.035852:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019660800:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.035873:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019660672:0@lo:400:kworker.0 00010000:00080000:2.0:1788851030.035899:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc1d77b80 x1875746019660928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851030.035909:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019660928:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.035916:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019660544:0@lo:400:kworker.0 00000100:00100000:2.0:1788851030.035923:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019661056:0@lo:400:kworker.0 00000100:00100000:0.0:1788851030.547077:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788851030.547104:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019661184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851030.547199:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851030.547509:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019661184 00000100:00100000:1.0:1788851030.547534:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019661184 00000100:00100000:1.0:1788851030.547605:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788851030.547616:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019661184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851030.547658:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851030.547731:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019661184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851030.547739:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788851030.547897:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b87ca4e00 x1875746019661184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851030.547919:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019661184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788851030.802089:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851031.826007:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851032.065058:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851032.065107:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851032.065137:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851032.065165:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851032.065208:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000754048 00000100:00100000:3.0:1788851032.065218:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000754048 00000100:00100000:2.0:1788851032.065238:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000753920 00000100:00100000:2.0:1788851032.065242:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000753920 00000100:00100000:3.0:1788851032.065281:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000754304 00000100:00100000:3.0:1788851032.065284:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000754304 00000100:00100000:2.0:1788851032.065286:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 252 00000100:00100000:2.0:1788851032.065296:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2351:x1875746000753920:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851032.065303:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 107 00000100:00100000:3.0:1788851032.065309:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:2351:x1875746000754048:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851032.065413:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000754176 00000100:00100000:1.0:1788851032.065417:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000754176 00000100:00100000:1.0:1788851032.065450:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:1.0:1788851032.065458:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2351:x1875746000754176:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788851032.065522:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2351:x1875746000753920:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 226us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851032.065530:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 252 00000100:00100000:3.0:1788851032.065826:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:2351:x1875746000754048:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 515us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851032.065833:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 107 00000100:00100000:3.0:1788851032.065848:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 108 00000100:00100000:3.0:1788851032.065855:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2351:x1875746000754304:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851032.065882:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2351:x1875746000754304:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 28us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851032.065888:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 108 00000100:00080000:3.0:1788851032.065907:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788851032.065912:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851032.079465:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2351:x1875746000754176:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 13991us (14341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851032.079483:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 51 00010000:00010000:1.0:1788851032.852185:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788851033.838964:0:11634:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788851033.875998:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788851034.706749:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967304 is committed 00000001:00080000:3.0:1788851034.708354:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1788851034.708379:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788851034.708717:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851034.708744:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019661312:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788851034.708865:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851034.708941:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019661312 00000100:00100000:1.0:1788851034.708952:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019661312 00000100:00100000:1.0:1788851034.709025:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788851034.709036:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019661312:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788851034.711564:0:6707:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788851034.711622:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9fb355, atime: 0x6a9fb355, ctime: 0x6a9fb355, blocks: 0x1 00010000:00010000:1.0:1788851034.711634:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035c5e7c2/0x7ad3e1a879576d94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851034.711677:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=367s v=(0 0) 00010000:00010000:1.0:1788851034.711682:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851034.711690:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035c5e7c2/0x7ad3e1a879576d94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851034.711712:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035c5e7c2/0x7ad3e1a879576d94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851034.711724:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035c5e7c2/0x7ad3e1a879576d94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851034.711734:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035c5e7c2/0x7ad3e1a879576d94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851034.711763:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851034.712275:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851034.712284:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035c5e7c2/0x7ad3e1a879576d94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851034.712294:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59000 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851034.712298:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035c5e7c2/0x7ad3e1a879576d94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851034.712320:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035c5e7c2/0x7ad3e1a879576d94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851034.712342:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035c5e7c2/0x7ad3e1a879576d94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851034.712349:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035c5e7c2/0x7ad3e1a879576d94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851034.712372:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851034.712374:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851034.712376:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851034.712875:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875746019661312:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3830us (3999us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788851034.712888:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788851034.712936:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788851034.713116:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a9b87ca5880/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788851034.713125:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019661312:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788851034.899953:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788851035.128308:0:11684:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff7eb9290 20000000:00000080:3.0:1788851035.128335:0:11684:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a9baefea000 uarg=0000000000000000 20000000:01000000:3.0:1788851035.128386:0:11684:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788851035.128395:0:11684:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788851035.128401:0:11684:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788851035.132522:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788851035.133413:0:11684:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788851035.141219:0:11684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788851035.142071:0:11684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788851035.142169:0:11684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788851035.142194:0:11684:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788851035.142220:0:11684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9b8168f200/0x7ad3e1a879576d9b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.142245:0:11684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576c36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea52 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.142254:0:11684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a2600/0x7ad3e1a879576c3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea59 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.142263:0:11684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a4a00/0x7ad3e1a879576c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576c44 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.142646:0:11684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576c59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576c52 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.142657:0:11684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576c67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576c60 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.142665:0:11684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9b8168f200/0x7ad3e1a879576d9b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.143144:0:11684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576c67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576c60 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.143229:0:11684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576c67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576c60 expref: 18 pid: 5853 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851035.143269:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11684:1875746019661440:0@lo:104: 00000100:00100000:3.0:1788851035.143356:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788851035.143437:0:11684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576c59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576c52 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.143447:0:11684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576c59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576c52 expref: 18 pid: 5853 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851035.143455:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11684:1875746019661568:0@lo:104: 00000100:00100000:0.0:1788851035.143457:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019661440 00000100:00100000:0.0:1788851035.143467:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019661440 00000100:00100000:3.0:1788851035.143477:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788851035.143510:0:11684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a4a00/0x7ad3e1a879576c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879576c44 expref: 18 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.143518:0:11684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8a9b814a4a00/0x7ad3e1a879576c4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879576c44 expref: 18 pid: 5853 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851035.143526:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11684:1875746019661696:0@lo:104: 00000100:00100000:0.0:1788851035.143526:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019661568 00000100:00100000:0.0:1788851035.143529:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019661568 00000100:00100000:0.0:1788851035.143548:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788851035.143550:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851035.143558:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+4:11684:x1875746019661440:12345-0@lo:104: 00010000:00010000:3.0:1788851035.143570:0:11684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a2600/0x7ad3e1a879576c3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea59 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.143571:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3e00/0x7ad3e1a879576c60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576c67 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851035.143577:0:5844:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1788851035.143582:0:11684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9b814a2600/0x7ad3e1a879576c3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea59 expref: 12 pid: 5853 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851035.143593:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d76680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11684:1875746019661824:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851035.143596:0:5844:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1788851035.143605:0:5844:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1788851035.143843:0:11684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576c36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea52 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851035.143855:0:11684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576c36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea52 expref: 12 pid: 5853 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851035.143865:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4130000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11684:1875746019661952:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851035.143931:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019661696 00000100:00100000:1.0:1788851035.143935:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019661696 00000100:00100000:1.0:1788851035.144064:0:11686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788851035.144072:0:11686:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+5:11684:x1875746019661568:12345-0@lo:104: 00010000:00010000:1.0:1788851035.144090:0:11686:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4600/0x7ad3e1a879576c52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576c59 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851035.145489:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98d7acc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788851035.150353:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788851035.150377:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+5:11684:x1875746019661440:12345-0@lo:104: Request processed in 6813us (7015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851035.150412:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788851035.150472:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788851035.150661:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baff1a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+4:11684:x1875746019661696:12345-0@lo:104: 00010000:00010000:0.0:1788851035.150684:0:5845:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b814a2a00/0x7ad3e1a879576c44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576c4b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.150800:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788851035.150806:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baff1a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ad19e61b-7666-4fee-85e9-385935a96ab4+4:11684:x1875746019661696:12345-0@lo:104: Request processed in 326us (7255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851035.150813:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788851035.150849:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788851035.150856:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3e00/0x7ad3e1a879576c60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576c67 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.150865:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a3e00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788851035.150870:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3e00/0x7ad3e1a879576c60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576c67 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.150880:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3e00/0x7ad3e1a879576c60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576c67 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851035.150889:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3e00/0x7ad3e1a879576c60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576c67 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851035.150896:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788851035.150949:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3e00/0x7ad3e1a879576c60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576c67 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.150957:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851035.150988:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3e00/0x7ad3e1a879576c60 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576c67 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.150996:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b814a3e00/0x7ad3e1a879576c60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576c67 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.151013:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851035.151017:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b814a2a00/0x7ad3e1a879576c44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576c4b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.151022:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a2a00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788851035.151026:0:5850:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a2a00/0x7ad3e1a879576c44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576c4b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.151046:0:5850:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b814a2a00/0x7ad3e1a879576c44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576c4b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851035.151054:0:5850:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a2a00/0x7ad3e1a879576c44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576c4b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851035.151060:0:5850:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788851035.151074:0:5850:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b814a2a00/0x7ad3e1a879576c44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576c4b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.151080:0:5850:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851035.151086:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a2a00/0x7ad3e1a879576c44 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576c4b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.151093:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b814a2a00/0x7ad3e1a879576c44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576c4b expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.151104:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851035.151111:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851035.151113:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851035.151120:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851035.151138:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019662080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851035.151256:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851035.151378:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851035.151384:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019662208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851035.151408:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851035.153151:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662080 00000100:00100000:0.0:1788851035.154439:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662080 00000100:00100000:3.0:1788851035.154713:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662208 00000100:00100000:3.0:1788851035.154721:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662208 00010000:00010000:3.0:1788851035.154767:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a4a00/0x7ad3e1a879576c4b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576c44 expref: 20 pid: 5853 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.155081:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576c67 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576c60 expref: 20 pid: 5853 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851035.155138:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788851035.155151:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad19e61b-7666-4fee-85e9-385935a96ab4+20:3308:x1875746019662208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851035.155171:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851035.155181:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a4a00/0x7ad3e1a879576c4b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576c44 expref: 20 pid: 5853 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.155195:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a4a00/0x7ad3e1a879576c4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576c44 expref: 20 pid: 5853 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.155222:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851035.155250:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788851035.155260:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+20:3308:x1875746019662080:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851035.155299:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad19e61b-7666-4fee-85e9-385935a96ab4+20:3308:x1875746019662208:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (3888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851035.155307:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:0.0:1788851035.155344:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851035.155352:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576c67 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576c60 expref: 19 pid: 5853 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.155364:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576c67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576c60 expref: 19 pid: 5853 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.155378:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851035.155419:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019662080:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (4163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851035.155429:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788851035.155473:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019662592:0@lo:400:kworker.0 00000100:00100000:3.0:1788851035.155521:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851035.155579:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019662208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851035.155593:0:11686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788851035.155594:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019662080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851035.155606:0:11686:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+3:11684:x1875746019661568:12345-0@lo:104: Request processed in 11532us (12125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851035.155630:0:11686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788851035.155631:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851035.155641:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019662720:0@lo:400:kworker.0 00000100:00100000:3.0:1788851035.155676:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851035.156055:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662592 00000100:00100000:1.0:1788851035.156062:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662592 00000100:00100000:1.0:1788851035.156113:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788851035.156121:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019662592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851035.156591:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019662336:0@lo:400:kworker.0 00000100:00100000:3.0:1788851035.156626:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851035.156644:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019662848:0@lo:400:kworker.0 00000100:00100000:3.0:1788851035.156661:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851035.156687:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788851035.156694:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019662464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851035.156717:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851035.156731:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019662976:0@lo:400:kworker.0 00000100:00100000:3.0:1788851035.156747:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851035.156802:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662720 00000100:00100000:3.0:1788851035.156807:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662720 00000100:00100000:3.0:1788851035.156851:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662976 00000100:00100000:3.0:1788851035.156854:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662976 00000100:00100000:3.0:1788851035.156873:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788851035.156879:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019662720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851035.156921:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019662720:12345-0@lo:400:kworker.0 Request processed in 42us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851035.156928:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788851035.156942:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788851035.156949:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875746019662976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851035.156981:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf040000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875746019662976:12345-0@lo:400:kworker.0 Request processed in 32us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851035.156986:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788851035.157004:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662336 00000100:00100000:3.0:1788851035.157007:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662336 00000100:00100000:3.0:1788851035.157021:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662848 00000100:00100000:3.0:1788851035.157023:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662848 00000100:00100000:3.0:1788851035.157046:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788851035.157052:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019662336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851035.157081:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019662336:12345-0@lo:400:kworker.0 Request processed in 30us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851035.157087:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788851035.157103:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788851035.157108:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019662848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851035.157131:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019662848:12345-0@lo:400:kworker.0 Request processed in 24us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851035.157137:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:3.0:1788851035.157170:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b87d76a00 x1875746019662720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851035.157184:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019662720:0@lo:400:kworker.0 00000100:00100000:3.0:1788851035.157206:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019662976:0@lo:400:kworker.0 00000100:00100000:3.0:1788851035.157214:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019662336:0@lo:400:kworker.0 00000100:00100000:3.0:1788851035.157221:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019662848:0@lo:400:kworker.0 00000100:00100000:3.0:1788851035.159090:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019662464 00000100:00100000:3.0:1788851035.159108:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019662464 00000100:00100000:3.0:1788851035.159184:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788851035.159195:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875746019662464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788851035.159245:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851035.159343:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf042a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875746019662464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 149us (2623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851035.159350:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1788851035.159381:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851035.159390:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4600/0x7ad3e1a879576c52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879576c59 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.159401:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4600 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:3.0:1788851035.159406:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4600/0x7ad3e1a879576c52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879576c59 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.159432:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4600/0x7ad3e1a879576c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879576c59 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851035.159441:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4600/0x7ad3e1a879576c52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879576c59 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851035.159447:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788851035.159577:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4600/0x7ad3e1a879576c52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576c59 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.159585:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851035.159608:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4600/0x7ad3e1a879576c52 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576c59 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.159616:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4600/0x7ad3e1a879576c52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879576c59 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.159642:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851035.159644:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851035.159645:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851035.159698:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019662464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851035.159746:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019663104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851035.160085:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851035.160244:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019663104 00000100:00100000:3.0:1788851035.160250:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019663104 00010000:00010000:3.0:1788851035.160276:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576c59 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576c52 expref: 19 pid: 5853 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851035.160305:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788851035.160321:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86786450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019663104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851035.160335:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851035.160342:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576c59 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879576c52 expref: 19 pid: 5853 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.160355:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576c59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879576c52 expref: 19 pid: 5853 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851035.160375:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851035.160407:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86786450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019663104:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851035.160413:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788851035.160559:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019663104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851035.160713:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019662592:12345-0@lo:400:kworker.0 Request processed in 4591us (5189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851035.160724:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00010000:2.0:1788851035.160921:0:11684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a5400/0x7ad3e1a879576c67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576c60 expref: 18 pid: 5853 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851035.160941:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11684:1875746019661440:0@lo:104: 00010000:00010000:2.0:1788851035.160959:0:11684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a3400/0x7ad3e1a879576c59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576c52 expref: 17 pid: 5853 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851035.160969:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11684:1875746019661568:0@lo:104: 00010000:00010000:2.0:1788851035.160980:0:11684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a4a00/0x7ad3e1a879576c4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879576c44 expref: 16 pid: 5853 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851035.160991:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11684:1875746019661696:0@lo:104: 00000100:00100000:3.0:1788851035.161595:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019662592:0@lo:400:kworker.0 00000100:00080000:0.0:1788851035.162148:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851035.162158:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851035.170645:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851035.170684:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851035.170734:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000754432 00000100:00100000:0.0:1788851035.170764:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000754432 00000100:00100000:1.0:1788851035.170827:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000754560 00000100:00100000:1.0:1788851035.170834:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000754560 00010000:00010000:0.0:1788851035.170852:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a2600/0x7ad3e1a879576c3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea59 expref: 14 pid: 5853 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851035.170859:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d76680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11684:1875746019661824:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851035.170859:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576c36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea52 expref: 14 pid: 5853 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851035.170900:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:1.0:1788851035.170910:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6835cbef-1345-4ac2-988d-7ad135109255+14:2354:x1875746000754560:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851035.170926:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851035.170933:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576c36 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea52 expref: 14 pid: 5853 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851035.170945:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576c36 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea52 expref: 14 pid: 5853 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851035.170972:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851035.170990:0:11684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a5c00/0x7ad3e1a879576c36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea52 expref: 14 pid: 5853 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851035.171005:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4130000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11684:1875746019661952:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851035.171049:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf043b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6835cbef-1345-4ac2-988d-7ad135109255+13:2354:x1875746000754560:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 139us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851035.171058:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 33 00010000:00010000:2.0:1788851035.171059:0:11684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9b8168f200/0x7ad3e1a879576d9b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851035.178716:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:2.0:1788851035.178859:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6835cbef-1345-4ac2-988d-7ad135109255+12:2354:x1875746000754432:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851035.178900:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851035.178914:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a2600/0x7ad3e1a879576c3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea59 expref: 12 pid: 5853 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851035.178956:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a2600/0x7ad3e1a879576c3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea59 expref: 12 pid: 5853 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851035.178980:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a2600/0x7ad3e1a879576c3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea59 expref: 12 pid: 5853 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851035.179005:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9b8168f200/0x7ad3e1a879576d9b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851035.179015:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b8168f200/0x7ad3e1a879576d9b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851035.179072:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b8168f200/0x7ad3e1a879576d9b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851035.179081:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b8168f200/0x7ad3e1a879576d9b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851035.179088:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9b8168f200/0x7ad3e1a879576d9b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851035.179096:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9b8168f200/0x7ad3e1a879576d9b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851035.179102:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f200 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851035.179107:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9b8168f200/0x7ad3e1a879576d9b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851035.179116:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9b8168f200/0x7ad3e1a879576d9b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851035.179157:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9b8168f200/0x7ad3e1a879576d9b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851035.179170:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851035.179254:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf043800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6835cbef-1345-4ac2-988d-7ad135109255+11:2354:x1875746000754432:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 521us (8625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851035.179266:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 34 00010000:00010000:0.0:1788851035.179382:0:11684:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9b8168f200/0x7ad3e1a879576d9b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.179393:0:11684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9b8168f200/0x7ad3e1a879576d9b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851035.179400:0:11684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b8168f200/0x7ad3e1a879576d9b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851035.666240:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851035.666272:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019663232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851035.666365:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851035.666724:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019663232 00000100:00100000:1.0:1788851035.666736:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019663232 00000100:00100000:1.0:1788851035.666835:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788851035.666847:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019663232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851035.666892:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851035.666957:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019663232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851035.666966:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788851035.671251:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b87ca7480 x1875746019663232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851035.671289:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019663232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788851035.922177:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851036.418267:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851036.419284:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000754688 00000100:00100000:2.0:1788851036.419298:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000754688 00000100:00100000:2.0:1788851036.419364:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 253 00000100:00100000:2.0:1788851036.419375:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+11:5606:x1875746000754688:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851036.419405:0:5853:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851036.419427:0:5853:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b90547800/0x7ad3e1a879576da2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeaa6 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851036.419459:0:5853:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90547800/0x7ad3e1a879576da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaa6 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851036.419472:0:5853:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b90547800/0x7ad3e1a879576da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaa6 expref: 12 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851036.419481:0:5853:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547800, rc 0) 00000100:00100000:2.0:1788851036.419556:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86602c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+12:5606:x1875746000754688:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 182us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851036.419564:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 253 00000100:00100000:1.0:1788851036.425870:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851036.426061:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000754816 00000100:00100000:2.0:1788851036.426076:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000754816 00000100:00100000:2.0:1788851036.426391:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 254 00000100:00100000:2.0:1788851036.426405:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+12:5606:x1875746000754816:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851036.426837:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86603c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+12:5606:x1875746000754816:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 433us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851036.426847:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 254 00000100:00100000:3.0:1788851036.429577:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851036.430510:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000754944 00000100:00100000:0.0:1788851036.430526:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000754944 00000100:00100000:0.0:1788851036.430587:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 255 00000100:00100000:0.0:1788851036.430598:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+12:5606:x1875746000754944:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788851036.430903:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86600050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+12:5606:x1875746000754944:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 Request processed in 306us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851036.430912:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 255 00000100:00100000:3.0:1788851036.434629:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851036.434738:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000755072 00000100:00100000:2.0:1788851036.434752:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000755072 00000100:00100000:2.0:1788851036.434848:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 256 00000100:00100000:2.0:1788851036.434860:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+12:9994:x1875746000755072:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788851036.435177:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+12:9994:x1875746000755072:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 318us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851036.435186:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 256 10000000:01000000:0.0:1788851036.436324:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788851036.436332:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9b866a7000 from 7 10000000:01000000:0.0:1788851036.436337:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788851036.436401:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851036.436415:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851036.436425:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851036.436454:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019663360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788851036.436530:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851036.436595:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788851036.436823:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019663360 00000100:00100000:1.0:1788851036.436831:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019663360 00000100:00100000:1.0:1788851036.436883:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788851036.436893:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+16:5858:x1875746019663360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851036.436906:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851036.436920:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9baef59200/0x7ad3e1a879576db0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576da9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851036.436946:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9baef59200/0x7ad3e1a879576db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576da9 expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851036.436957:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9baef59200/0x7ad3e1a879576db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576da9 expref: 17 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851036.436966:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59200, rc 0) 00000100:00100000:1.0:1788851036.437020:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019663360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851036.437026:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788851036.437140:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019663360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851036.437157:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576db0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851036.437166:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576db0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851036.437230:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019663488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851036.437274:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851036.437303:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98d7ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851036.437453:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019663488 00000100:00100000:1.0:1788851036.437470:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019663488 00000100:00100000:1.0:1788851036.437500:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788851036.437506:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019663488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851036.437837:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019663488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 330us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851036.437844:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788851036.439537:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019663488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851036.439618:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019663616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851036.439835:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851036.439888:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98d7ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851036.440020:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019663616 00000100:00100000:1.0:1788851036.440029:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019663616 00000100:00100000:1.0:1788851036.440090:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788851036.440226:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019663616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851036.440629:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019663616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 407us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851036.440637:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1788851036.440830:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019663616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851036.447410:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4130000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:11698:1875746019663744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851036.447668:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.447740:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851036.447902:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019663744 00000100:00100000:3.0:1788851036.447912:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019663744 00000100:00100000:3.0:1788851036.447977:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788851036.447988:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+17:11698:x1875746019663744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788851036.448297:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+17:11698:x1875746019663744:12345-0@lo:502:llog_process_th.0 Request processed in 309us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851036.448306:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788851036.448609:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4130000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:11698:1875746019663744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788851036.448655:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851036.448668:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851036.448670:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788851036.448680:0:11698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a9b866a7000 00000020:00000080:2.0:1788851036.448683:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788851036.448838:0:11698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4130000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:11698:1875746019663872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851036.448883:0:11698:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.448926:0:11698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851036.448966:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019663872 00000100:00100000:2.0:1788851036.448978:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019663872 00000100:00100000:2.0:1788851036.449019:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788851036.449028:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:11698:x1875746019663872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851036.449718:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+17:11698:x1875746019663872:12345-0@lo:502:llog_process_th.0 Request processed in 687us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851036.449728:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788851036.456804:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851036.456971:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000755200 00000100:00100000:2.0:1788851036.456985:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000755200 00000100:00100000:2.0:1788851036.457064:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 262 00000100:00100000:2.0:1788851036.457077:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+12:9994:x1875746000755200:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788851036.457399:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+12:9994:x1875746000755200:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 324us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851036.457408:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 262 00000100:00100000:0.0:1788851036.460298:0:11698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4130000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:11698:1875746019663872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788851036.460372:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851036.460386:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851036.460390:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788851036.460396:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788851036.476535:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788851036.476590:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788851036.476606:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576db0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851036.476623:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576db0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851036.476637:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788851036.476641:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9ba049f800 from 7 10000000:01000000:1.0:1788851036.476645:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788851036.476875:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851036.476885:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851036.476915:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851036.476949:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019664000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788851036.477058:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851036.477163:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b90579cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851036.485053:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851036.493521:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664000 00000100:00100000:2.0:1788851036.493543:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664000 00000100:00100000:2.0:1788851036.493609:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000755328 00000100:00100000:2.0:1788851036.493613:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000755328 00000100:00100000:2.0:1788851036.493635:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788851036.493646:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+17:5858:x1875746019664000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851036.493666:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851036.493690:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b90546200/0x7ad3e1a879576dbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576db7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851036.494026:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90546200/0x7ad3e1a879576dbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576db7 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851036.494039:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b90546200/0x7ad3e1a879576dbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576db7 expref: 18 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851036.494066:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546200, rc 0) 00000100:00100000:2.0:1788851036.494171:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019664000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 527us (17113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851036.494178:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788851036.494219:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 264 00000100:00100000:2.0:1788851036.494227:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+12:5606:x1875746000755328:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851036.494236:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851036.494247:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b90547e00/0x7ad3e1a879576dc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeaad expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851036.494261:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90547e00/0x7ad3e1a879576dc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaad expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851036.494268:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b90547e00/0x7ad3e1a879576dc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaad expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851036.494274:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547e00, rc 0) 00000100:00100000:2.0:1788851036.494319:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:5606:x1875746000755328:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 94us (9282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851036.494325:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 264 00000100:00100000:1.0:1788851036.494440:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019664000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851036.494472:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576dbe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851036.494483:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576dbe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851036.494578:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019664128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851036.494619:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851036.494662:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b90579cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851036.495106:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664128 00000100:00100000:2.0:1788851036.495114:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664128 00000100:00100000:2.0:1788851036.495156:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788851036.495163:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019664128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851036.495955:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019664128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 789us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851036.495976:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788851036.496641:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019664128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851036.496718:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019664256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851036.496776:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851036.496838:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b90579cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851036.496960:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664256 00000100:00100000:2.0:1788851036.496968:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664256 00000100:00100000:2.0:1788851036.497052:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788851036.497062:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019664256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851036.497277:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019664256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 216us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851036.497284:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788851036.497336:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019664256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851036.497568:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4133480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:11701:1875746019664384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851036.497609:0:11701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.497628:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788851036.501826:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664384 00000100:00100000:1.0:1788851036.501851:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664384 00000100:00100000:1.0:1788851036.501941:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788851036.501953:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:11701:x1875746019664384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851036.502330:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:11701:x1875746019664384:12345-0@lo:502:llog_process_th.0 Request processed in 378us (4718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851036.502338:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788851036.503942:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851036.504037:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4133480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:11701:1875746019664384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788851036.504122:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851036.504139:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851036.504151:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788851036.504164:0:11701:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a9ba049f800 00000020:00000080:2.0:1788851036.504166:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788851036.505845:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000755456 00000100:00100000:1.0:1788851036.505859:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000755456 00000100:00100000:1.0:1788851036.505933:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 268 00000100:00100000:1.0:1788851036.505944:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:5606:x1875746000755456:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851036.506988:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4133480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:11701:1875746019664512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851036.507103:0:11701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.507598:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788851036.507617:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:5606:x1875746000755456:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 1672us (3970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851036.507628:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 268 00000100:00100000:1.0:1788851036.507664:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664512 00000100:00100000:1.0:1788851036.507671:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664512 00000100:00100000:1.0:1788851036.507699:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788851036.507707:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:11701:x1875746019664512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851036.507955:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:11701:x1875746019664512:12345-0@lo:502:llog_process_th.0 Request processed in 248us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851036.507962:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788851036.509081:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4133480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:11701:1875746019664512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788851036.509139:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851036.509156:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851036.509159:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788851036.509165:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788851036.509249:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788851036.509276:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788851036.509289:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576dbe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851036.509304:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576dbe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851036.509317:0:5858:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788851036.509321:0:5858:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9ba0462000 from 7 10000000:01000000:2.0:1788851036.509324:0:5858:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788851036.509364:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851036.509373:0:5858:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851036.509383:0:5858:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851036.509409:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4133480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019664640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788851036.510085:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851036.510121:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000755584 00000100:00100000:3.0:1788851036.510129:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000755584 00000100:00100000:3.0:1788851036.510176:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 270 00000100:00100000:3.0:1788851036.510187:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:5606:x1875746000755584:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851036.510411:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:5606:x1875746000755584:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 Request processed in 225us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851036.510419:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 270 00000040:00080000:1.0:1788851036.511643:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788851036.512621:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.512685:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788851036.512906:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664640 00000100:00100000:1.0:1788851036.512917:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664640 00000100:00100000:1.0:1788851036.512975:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788851036.512987:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:5858:x1875746019664640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851036.513016:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851036.513039:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9baef58400/0x7ad3e1a879576dd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879576dcc expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851036.513087:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9baef58400/0x7ad3e1a879576dd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879576dcc expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851036.513194:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9baef58400/0x7ad3e1a879576dd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879576dcc expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851036.513206:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58400, rc 0) 00000100:00100000:1.0:1788851036.513313:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019664640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 329us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851036.513321:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788851036.521872:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4133480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019664640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851036.521914:0:5858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576dd3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851036.521946:0:5858:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576dd3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851036.522070:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4133480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019664768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851036.522163:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.522227:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafcc2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788851036.523229:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851036.523353:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664768 00000100:00100000:2.0:1788851036.523364:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664768 00000100:00100000:2.0:1788851036.523417:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000755712 00000100:00100000:2.0:1788851036.523421:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000755712 00000100:00100000:2.0:1788851036.523437:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788851036.523447:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019664768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851036.524247:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 273 00000100:00100000:1.0:1788851036.524260:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:9997:x1875746000755712:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788851036.533443:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:9997:x1875746000755712:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 9166us (10199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851036.533472:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 273 00000100:00100000:2.0:1788851036.543328:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019664768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 19866us (21149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851036.543347:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788851036.543478:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4133480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019664768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788851036.543564:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019664896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788851036.543624:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851036.543673:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0900 going to sleep for 11 seconds 00000100:00100000:2.0:1788851036.543908:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019664896 00000100:00100000:2.0:1788851036.543917:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019664896 00000100:00100000:2.0:1788851036.543977:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788851036.543987:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019664896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851036.544238:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:5858:x1875746019664896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851036.544245:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788851036.544291:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ad19e61b-7666-4fee-85e9-385935a96ab4:5858:1875746019664896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851036.552436:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4131180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:11704:1875746019665024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851036.552570:0:11704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.552634:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665024 00000100:00100000:2.0:1788851036.552642:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665024 00000100:00100000:2.0:1788851036.552691:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788851036.552715:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:11704:x1875746019665024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851036.552995:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:11704:x1875746019665024:12345-0@lo:502:llog_process_th.0 Request processed in 295us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851036.553015:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788851036.553081:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9ba2508d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788851036.553118:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4131180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:11704:1875746019665024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788851036.553155:0:11704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851036.553167:0:11704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851036.553170:0:11704:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788851036.553179:0:11704:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a9ba0462000 00000020:00000080:2.0:1788851036.553181:0:11704:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788851036.553551:0:11704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4131180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:11704:1875746019665152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851036.553591:0:11704:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851036.553613:0:11704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9ba2508d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788851036.553696:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665152 00000100:00100000:1.0:1788851036.553703:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665152 00000100:00100000:1.0:1788851036.553739:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788851036.553748:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:11704:x1875746019665152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851036.553937:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:11704:x1875746019665152:12345-0@lo:502:llog_process_th.0 Request processed in 190us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851036.553944:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788851036.555292:0:11704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4131180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ad19e61b-7666-4fee-85e9-385935a96ab4:11704:1875746019665152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788851036.555347:0:11704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851036.555359:0:11704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851036.555362:0:11704:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788851036.555368:0:11704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:0.0:1788851036.556690:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851036.557999:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000755840 00000100:00100000:3.0:1788851036.558024:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000755840 00000100:00100000:3.0:1788851036.558081:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 277 00000100:00100000:3.0:1788851036.558112:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:9997:x1875746000755840:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788851036.558384:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:9997:x1875746000755840:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 285us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851036.558393:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 277 00000020:01000000:1.0:1788851036.567489:0:5858:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788851036.567540:0:5858:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788851036.567576:0:5858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576dd3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851036.567592:0:5858:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576dd3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851036.947762:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851037.185715:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851037.185832:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851037.186030:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851037.186079:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851037.186123:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000756224 00000100:00100000:1.0:1788851037.186132:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000756224 00000100:00100000:0.0:1788851037.186136:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000755968 00000100:00100000:0.0:1788851037.186151:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000755968 00000100:00100000:1.0:1788851037.186207:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:1.0:1788851037.186220:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000756224:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851037.186237:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 278 00000100:00100000:0.0:1788851037.186274:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000755968:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851037.186304:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000756224:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 85us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851037.186313:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:0.0:1788851037.186355:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000755968:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 86us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851037.186366:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 278 00000100:00080000:1.0:1788851037.186375:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851037.187279:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000756096 00000100:00100000:3.0:1788851037.187288:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000756096 00000100:00100000:3.0:1788851037.187398:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000756352 00000100:00100000:3.0:1788851037.187402:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000756352 00000100:00100000:0.0:1788851037.187479:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 112 00000100:00100000:0.0:1788851037.187491:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000756096:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851037.187555:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000756096:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 67us (1852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851037.187562:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 112 00000100:00080000:1.0:1788851037.188199:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851037.188375:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 113 00000100:00100000:3.0:1788851037.188385:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000756352:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851037.188431:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000756352:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 48us (2599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851037.188437:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 113 00000040:00080000:1.0:1788851037.523226:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788851037.970075:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851038.994208:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788851039.835146:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1788851040.019302:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851040.274058:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019665280:0@lo:400:kworker.0 00000100:00100000:0.0:1788851040.274145:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851040.274231:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788851040.274239:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019665408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851040.274272:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851040.274325:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665408 00000100:00100000:0.0:1788851040.274334:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665408 00000100:00100000:0.0:1788851040.274397:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788851040.274407:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019665408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851040.274450:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788851040.274500:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019665408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851040.274508:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788851040.274530:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788851040.274576:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788851040.274582:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a9b87ca5880, transno 4294967300 00000100:00100000:0.0:1788851040.274601:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019665408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851040.275060:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665280 00000100:00100000:0.0:1788851040.275066:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665280 00000100:00100000:0.0:1788851040.275096:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788851040.275103:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019665280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851040.275149:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019665280:12345-0@lo:400:kworker.0 Request processed in 46us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851040.275156:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788851040.275191:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019665280:0@lo:400:kworker.0 00000100:00100000:0.0:1788851040.275458:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019665536:0@lo:400:kworker.0 00000100:00100000:0.0:1788851040.275491:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851040.275516:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851040.275521:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019665664:0@lo:400:kworker.0 00000100:00100000:0.0:1788851040.275542:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851040.275568:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665536 00000100:00100000:0.0:1788851040.275571:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665536 00000100:00100000:0.0:1788851040.275596:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665664 00000100:00100000:0.0:1788851040.275606:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665664 00000100:00100000:0.0:1788851040.275639:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788851040.275646:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019665536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851040.275685:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019665536:12345-0@lo:400:kworker.0 Request processed in 39us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851040.275692:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788851040.275706:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788851040.275721:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019665664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851040.275765:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019665664:12345-0@lo:400:kworker.0 Request processed in 44us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851040.275772:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788851040.275808:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851040.275829:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019665664:0@lo:400:kworker.0 00000100:00100000:0.0:1788851040.275839:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019665536:0@lo:400:kworker.0 00000100:00100000:0.0:1788851040.275875:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019665792:0@lo:400:kworker.0 00000100:00100000:0.0:1788851040.275902:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851040.275950:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665792 00000100:00100000:0.0:1788851040.275954:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665792 00000100:00100000:0.0:1788851040.275984:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788851040.275991:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019665792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851040.276027:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019665792:12345-0@lo:400:kworker.0 Request processed in 37us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851040.276032:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788851040.276046:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788851040.276064:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bc1ee3800 x1875746019665792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851040.276076:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019665792:0@lo:400:kworker.0 00000100:00100000:0.0:1788851040.280900:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019665920:0@lo:400:kworker.0 00000100:00100000:0.0:1788851040.280996:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851040.281138:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019665920 00000100:00100000:2.0:1788851040.281147:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019665920 00000100:00100000:2.0:1788851040.281251:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788851040.281262:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019665920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851040.281350:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019665920:12345-0@lo:400:kworker.0 Request processed in 90us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851040.281357:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788851040.281570:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019665920:0@lo:400:kworker.0 00000100:00080000:0.0:1788851040.281870:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851040.786073:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788851040.786101:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019666048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851040.786185:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851040.786366:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666048 00000100:00100000:1.0:1788851040.786377:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666048 00000100:00100000:1.0:1788851040.786435:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788851040.786445:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019666048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851040.786484:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851040.786539:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019666048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851040.786563:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788851040.787185:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b87ca5880 x1875746019666048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851040.787222:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019666048:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788851041.042091:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851042.066436:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851042.311923:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851042.312039:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000756480 00000100:00100000:0.0:1788851042.312066:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000756480 00000100:00100000:0.0:1788851042.312129:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 280 00000100:00100000:0.0:1788851042.312140:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2354:x1875746000756480:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851042.312225:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2354:x1875746000756480:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 87us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851042.312233:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 280 00000100:00100000:1.0:1788851042.319818:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851042.319870:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851042.320426:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000756736 00000100:00100000:3.0:1788851042.320439:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000756736 00000100:00100000:3.0:1788851042.320513:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:3.0:1788851042.320525:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2354:x1875746000756736:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851042.320607:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2354:x1875746000756736:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 84us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851042.320614:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00080000:2.0:1788851042.321537:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851042.324760:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851042.324904:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000756608 00000100:00100000:0.0:1788851042.324915:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000756608 00000100:00100000:0.0:1788851042.324988:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000756864 00000100:00100000:0.0:1788851042.324992:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000756864 00000100:00100000:0.0:1788851042.325028:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 117 00000100:00100000:0.0:1788851042.325039:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000756608:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851042.325045:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 118 00000100:00100000:3.0:1788851042.325069:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000756864:12345-192.168.204.6@tcp:400:kworker.0 00000100:00080000:1.0:1788851042.325185:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851042.325320:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000756608:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 281us (5447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851042.325328:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 117 00000100:00100000:3.0:1788851042.330948:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000756864:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 5257us (5576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851042.330965:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 118 00010000:00010000:0.0:1788851043.091754:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851044.114265:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851045.139990:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851045.394483:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019666304:0@lo:400:kworker.0 00000100:00100000:1.0:1788851045.394556:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851045.394617:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019666816:0@lo:400:kworker.0 00000100:00100000:1.0:1788851045.394644:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851045.394673:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851045.394680:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafeab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019666432:0@lo:400:kworker.0 00000100:00100000:1.0:1788851045.394701:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851045.394734:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666304 00000100:00100000:1.0:1788851045.394741:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666304 00000100:00100000:1.0:1788851045.394800:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666432 00000100:00100000:1.0:1788851045.394804:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666432 00000100:00100000:1.0:1788851045.394850:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788851045.394860:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019666304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851045.394915:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019666304:12345-0@lo:400:kworker.0 Request processed in 57us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851045.394923:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788851045.394942:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788851045.394948:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019666432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851045.394973:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019666432:12345-0@lo:400:kworker.0 Request processed in 25us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851045.394997:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1788851045.395017:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851045.395049:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafeab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019666432:0@lo:400:kworker.0 00000100:00100000:1.0:1788851045.395059:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019666304:0@lo:400:kworker.0 00000100:00100000:2.0:1788851045.395977:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019666176:0@lo:400:kworker.0 00000100:00100000:2.0:1788851045.396026:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851045.396066:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafeab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019666688:0@lo:400:kworker.0 00000100:00100000:2.0:1788851045.396089:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851045.396107:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851045.396112:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019666560:0@lo:400:kworker.0 00000100:00100000:2.0:1788851045.396134:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851045.397660:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666816 00000100:00100000:0.0:1788851045.397673:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666816 00000100:00100000:0.0:1788851045.397737:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666560 00000100:00100000:0.0:1788851045.397753:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666560 00000100:00100000:0.0:1788851045.397799:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788851045.397810:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019666816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851045.397911:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019666816:12345-0@lo:400:kworker.0 Request processed in 103us (3266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851045.397919:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788851045.397936:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788851045.397943:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019666560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851045.397994:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4130700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019666560:12345-0@lo:400:kworker.0 Request processed in 51us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851045.398000:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788851045.398021:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666688 00000100:00100000:0.0:1788851045.398025:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666688 00000100:00100000:0.0:1788851045.398054:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788851045.398060:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019666688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851045.398093:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019666688:12345-0@lo:400:kworker.0 Request processed in 33us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851045.398099:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:0.0:1788851045.398153:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bafea8e00 x1875746019666560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851045.398169:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019666560:0@lo:400:kworker.0 00000100:00100000:0.0:1788851045.398183:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafeab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019666688:0@lo:400:kworker.0 00000100:00080000:0.0:1788851045.398211:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788851045.398216:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851045.398218:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851045.399092:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafea8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019666816:0@lo:400:kworker.0 00000100:00100000:2.0:1788851045.399664:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851045.399676:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019666944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851045.399733:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851045.399778:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666944 00000100:00100000:2.0:1788851045.399802:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666944 00000100:00100000:2.0:1788851045.399858:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788851045.399867:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019666944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851045.399905:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788851045.399948:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019666944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851045.399954:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788851045.400007:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019666944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851045.400532:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019666176 00000100:00100000:3.0:1788851045.400539:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019666176 00000100:00100000:3.0:1788851045.400568:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788851045.400575:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019666176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851045.400621:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019666176:12345-0@lo:400:kworker.0 Request processed in 47us (4594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851045.400627:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788851045.407487:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ee3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019666176:0@lo:400:kworker.0 00000100:00100000:2.0:1788851045.908062:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851045.908087:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019667072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851045.908158:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851045.908760:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667072 00000100:00100000:1.0:1788851045.908770:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667072 00000100:00100000:1.0:1788851045.908910:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788851045.908920:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019667072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851045.908958:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851045.909012:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4130380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019667072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851045.909019:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788851045.909095:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b87ca5880 x1875746019667072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851045.909114:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019667072:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788851046.162059:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851047.189207:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851047.433539:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851047.433592:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851047.433629:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851047.433671:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851047.433703:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000757120 00000100:00100000:1.0:1788851047.433712:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000757120 00000100:00100000:1.0:1788851047.433770:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000757376 00000100:00100000:1.0:1788851047.433773:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000757376 00000100:00100000:1.0:1788851047.433846:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 122 00000100:00100000:1.0:1788851047.433856:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2352:x1875746000757120:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788851047.433931:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000757248 00000100:00100000:2.0:1788851047.433936:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000757248 00000100:00100000:1.0:1788851047.433937:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2352:x1875746000757120:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 83us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851047.433970:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:2.0:1788851047.433977:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2351:x1875746000757248:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851047.433978:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 122 00000100:00100000:1.0:1788851047.433996:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 123 00000100:00100000:1.0:1788851047.434002:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37963b51-fe0d-42c0-b479-a7af644fd745+5:2352:x1875746000757376:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788851047.434005:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2351:x1875746000757248:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 30us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851047.434011:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:1.0:1788851047.434025:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37963b51-fe0d-42c0-b479-a7af644fd745+5:2352:x1875746000757376:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 23us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851047.434031:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 123 00000100:00080000:2.0:1788851047.434048:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788851047.434052:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851047.438682:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000756992 00000100:00100000:0.0:1788851047.438699:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000756992 00000100:00100000:0.0:1788851047.438777:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 282 00000100:00100000:0.0:1788851047.438843:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2351:x1875746000756992:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851047.438926:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2351:x1875746000756992:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 86us (5333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851047.438952:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 282 00000040:00080000:0.0:1788851047.762523:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788851048.215397:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851049.234022:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851050.259962:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851050.514120:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851050.514149:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019667200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851050.514222:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851050.514667:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667200 00000100:00100000:2.0:1788851050.514675:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667200 00000100:00100000:2.0:1788851050.514757:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788851050.514767:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019667200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851050.514825:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788851050.514878:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019667200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851050.514885:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788851050.514979:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4133480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019667200:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788851050.515060:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851050.515264:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788851050.522180:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019667456:0@lo:400:kworker.0 00000100:00100000:1.0:1788851050.522265:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851050.522430:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667456 00000100:00100000:2.0:1788851050.522439:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667456 00000100:00100000:2.0:1788851050.522520:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788851050.522529:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019667456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851050.524191:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019667328:0@lo:400:kworker.0 00000100:00100000:0.0:1788851050.525354:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019667712:0@lo:400:kworker.0 00000100:00100000:3.0:1788851050.525428:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019667840:0@lo:400:kworker.0 00000100:00100000:2.0:1788851050.528285:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019667456:12345-0@lo:400:kworker.0 Request processed in 5746us (6008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851050.528322:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788851050.528411:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019667584:0@lo:400:kworker.0 00000100:00100000:2.0:1788851050.528463:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851050.528536:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667584 00000100:00100000:2.0:1788851050.528545:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667584 00000100:00100000:2.0:1788851050.528602:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788851050.528611:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019667584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851050.528668:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4130000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019667584:12345-0@lo:400:kworker.0 Request processed in 58us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851050.528674:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788851050.528713:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019667584:0@lo:400:kworker.0 00000100:00080000:2.0:1788851050.528758:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851050.529019:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851050.529081:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019667456:0@lo:400:kworker.0 00000100:00100000:2.0:1788851050.531209:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667328 00000100:00100000:2.0:1788851050.531228:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667328 00000100:00100000:2.0:1788851050.531324:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788851050.531336:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019667328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851050.531431:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019667328:12345-0@lo:400:kworker.0 Request processed in 98us (2412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851050.531438:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788851050.531820:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019667328:0@lo:400:kworker.0 00000100:00100000:0.0:1788851050.531975:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851050.535832:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667712 00000100:00100000:1.0:1788851050.535849:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667712 00000100:00100000:1.0:1788851050.535932:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788851050.535944:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019667712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851050.536059:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019667712:12345-0@lo:400:kworker.0 Request processed in 118us (4084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851050.536087:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1788851050.536262:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b87ca0700 x1875746019667712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851050.536281:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019667712:0@lo:400:kworker.0 00000100:00080000:2.0:1788851050.536521:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851050.540509:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851050.540667:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667840 00000100:00100000:2.0:1788851050.540676:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667840 00000100:00100000:2.0:1788851050.540758:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788851050.540815:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019667840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851050.540885:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019667840:12345-0@lo:400:kworker.0 Request processed in 103us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851050.540892:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788851050.540989:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019667840:0@lo:400:kworker.0 00000100:00080000:3.0:1788851050.541227:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851051.026242:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019667968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851051.026333:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851051.026411:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019667968 00000100:00100000:3.0:1788851051.026420:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019667968 00000100:00100000:3.0:1788851051.026473:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788851051.026483:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4133480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019667968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851051.026529:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851051.026585:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4133480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019667968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851051.026593:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788851051.027051:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b8bcf1500 x1875746019667968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851051.027075:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019667968:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788851051.282485:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851052.306067:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851052.547124:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851052.547349:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851052.547455:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000757504 00000100:00100000:3.0:1788851052.547490:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000757504 00000100:00100000:3.0:1788851052.547554:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 284 00000100:00100000:3.0:1788851052.547565:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:2351:x1875746000757504:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851052.547663:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:2351:x1875746000757504:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 100us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851052.547672:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 284 00000100:00100000:2.0:1788851052.551466:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000757632 00000100:00100000:2.0:1788851052.551485:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000757632 00000100:00100000:2.0:1788851052.555953:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 127 00000100:00100000:2.0:1788851052.555983:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2351:x1875746000757632:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788851052.556186:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2351:x1875746000757632:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 216us (8835us total) trans 0 rc 0/0 00000100:00080000:3.0:1788851052.556243:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851052.559380:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851052.559613:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000757760 00000100:00100000:0.0:1788851052.559624:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000757760 00000100:00100000:3.0:1788851052.559658:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851052.559708:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:0.0:1788851052.559722:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2350:x1875746000757760:12345-192.168.204.6@tcp:9:kworker.0 00000100:00100000:3.0:1788851052.559724:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000757888 00000100:00100000:3.0:1788851052.559730:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000757888 00000100:00100000:3.0:1788851052.559775:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 128 00000100:00100000:3.0:1788851052.559806:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+5:2352:x1875746000757888:12345-192.168.204.6@tcp:400:kworker.0 00000020:00000080:0.0:1788851052.559852:0:6707:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576d0f 00000100:00080000:0.0:1788851052.559865:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8a9bc1e05000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788851052.559869:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+5:2352:x1875746000757888:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851052.559887:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 128 00000001:00000004:0.0:1788851052.559917:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1788851052.559920:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788851052.559940:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788851052.560015:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788851052.560188:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+2:2350:x1875746000757760:12345-192.168.204.6@tcp:9:kworker.0 Request processed in 469us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851052.560196:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:2.0:1788851052.571113:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 127 00010000:00010000:0.0:1788851053.330290:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851054.354076:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788851055.214703:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c328062-9d4c-41e6-ae57-f4af3bf37898 00000020:00000080:3.0:1788851055.214714:0:7656:0:(genops.c:885:class_export_put()) final put ffff8a9bc1e00000/3c328062-9d4c-41e6-ae57-f4af3bf37898 00000020:00000080:2.0:1788851055.214806:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bc1e00000/3c328062-9d4c-41e6-ae57-f4af3bf37898 for lustre-OST0001 00000020:00000080:2.0:1788851055.214863:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9bc1e05000 for lustre-OST0001 00010000:00010000:3.0:1788851055.384346:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851055.634964:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019668096:0@lo:400:kworker.0 00000100:00100000:2.0:1788851055.635053:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851055.635322:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668096 00000100:00100000:1.0:1788851055.635330:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668096 00000100:00100000:1.0:1788851055.635384:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788851055.635393:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019668096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851055.635759:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019668480:0@lo:400:kworker.0 00000100:00100000:3.0:1788851055.635825:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851055.635877:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788851055.635884:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019668352:0@lo:400:kworker.0 00000100:00100000:3.0:1788851055.635907:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851055.635991:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788851055.635998:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019668864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851055.636024:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851055.636054:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668864 00000100:00100000:3.0:1788851055.636058:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668864 00000100:00100000:3.0:1788851055.636099:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788851055.636107:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafeab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019668864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788851055.636140:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851055.636353:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafeab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019668864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 246us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851055.636361:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788851055.636381:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851055.636412:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019668864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851055.636448:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019668224:0@lo:400:kworker.0 00000100:00100000:3.0:1788851055.636472:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851055.636488:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019668736:0@lo:400:kworker.0 00000100:00100000:3.0:1788851055.636521:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851055.636556:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668352 00000100:00100000:3.0:1788851055.636560:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668352 00000100:00100000:3.0:1788851055.636588:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668224 00000100:00100000:3.0:1788851055.636591:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668224 00000100:00100000:3.0:1788851055.636608:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788851055.636614:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafeab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019668352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851055.636665:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafeab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019668352:12345-0@lo:400:kworker.0 Request processed in 51us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851055.636672:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788851055.636684:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788851055.636697:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019668224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851055.636729:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019668224:12345-0@lo:400:kworker.0 Request processed in 34us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851055.636735:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1788851055.636749:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851055.636767:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019668352:0@lo:400:kworker.0 00000100:00100000:3.0:1788851055.636809:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019668224:0@lo:400:kworker.0 00000100:00100000:0.0:1788851055.644567:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668480 00000100:00100000:0.0:1788851055.644605:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668480 00000100:00100000:0.0:1788851055.644689:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668736 00000100:00100000:0.0:1788851055.644693:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668736 00000100:00100000:0.0:1788851055.644719:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788851055.644730:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019668480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851055.645202:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3308:x1875746019668096:12345-0@lo:400:kworker.0 Request processed in 9807us (10146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851055.645280:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788851055.645333:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788851055.645341:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019668736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851055.645658:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019668736:12345-0@lo:400:kworker.0 Request processed in 316us (9134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851055.645665:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788851055.645718:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019668736:0@lo:400:kworker.0 00000100:00100000:2.0:1788851055.646318:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019668096:0@lo:400:kworker.0 00000100:00100000:2.0:1788851055.646334:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875746019668608:0@lo:400:kworker.0 00000100:00100000:2.0:1788851055.646383:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851055.646528:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668608 00000100:00100000:2.0:1788851055.646547:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668608 00000100:00100000:2.0:1788851055.646590:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788851055.646598:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875746019668608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851055.646653:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875746019668608:12345-0@lo:400:kworker.0 Request processed in 56us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851055.646659:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788851055.646689:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875746019668608:0@lo:400:kworker.0 00000100:00080000:2.0:1788851055.646748:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851055.646753:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851055.648201:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019668480:12345-0@lo:400:kworker.0 Request processed in 3465us (12366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851055.649314:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1788851055.649533:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b87d76680 x1875746019668480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851055.649549:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019668480:0@lo:400:kworker.0 00000100:00100000:1.0:1788851056.160703:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019668992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851056.160813:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851056.161059:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019668992 00000100:00100000:3.0:1788851056.161067:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019668992 00000100:00100000:3.0:1788851056.161129:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788851056.161139:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019668992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851056.161179:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851056.161234:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019668992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851056.161242:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1788851056.161285:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9b8bcf1500 x1875746019668992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851056.161305:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019668992:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788851056.405870:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851057.430371:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851057.671428:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851057.671482:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851057.671512:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851057.671629:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000758144 00000100:00100000:0.0:1788851057.671643:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000758144 00000100:00100000:3.0:1788851057.671668:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000758016 00000100:00100000:3.0:1788851057.671674:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000758016 00000100:00100000:0.0:1788851057.671734:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000758272 00000100:00100000:0.0:1788851057.671739:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000758272 00000100:00100000:3.0:1788851057.671741:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 286 00000100:00100000:3.0:1788851057.671757:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000758016:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851057.671774:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 132 00000100:00100000:0.0:1788851057.671818:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000758144:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851057.671884:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000758016:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 129us (399us total) trans 0 rc 0/0 00000100:00080000:1.0:1788851057.671890:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851057.671895:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 286 00000100:00100000:0.0:1788851057.672655:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000758144:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 865us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851057.672665:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 132 00000100:00100000:0.0:1788851057.672688:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 133 00000100:00100000:0.0:1788851057.672698:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000758272:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851057.672735:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000758272:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 39us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851057.672741:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 133 00000040:00080000:1.0:1788851058.002489:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788851058.454431:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851059.479334:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788851060.289071:0:11867:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 03:04:18 (1788851058) 00010000:00010000:1.0:1788851060.500227:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851060.754471:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb39b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019669120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851060.754564:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851060.755089:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019669120 00000100:00100000:0.0:1788851060.755099:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019669120 00000100:00100000:0.0:1788851060.755199:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788851060.755210:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019669120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851060.755250:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788851060.755302:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019669120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851060.755309:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788851060.757199:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb39b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019669504:0@lo:400:kworker.0 00000100:00100000:3.0:1788851060.757264:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851060.757274:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb39b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019669248:0@lo:400:kworker.0 00000100:00100000:3.0:1788851060.757313:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788851060.757325:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb39b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019669376:0@lo:400:kworker.0 00000100:00100000:0.0:1788851060.757476:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019669504 00000100:00100000:0.0:1788851060.757484:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019669504 00000100:00100000:0.0:1788851060.757546:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788851060.757556:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019669504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851060.757613:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851060.757647:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019669376 00000100:00100000:3.0:1788851060.757651:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019669376 00000100:00100000:3.0:1788851060.757675:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788851060.757682:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019669376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851060.757719:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019669376:12345-0@lo:400:kworker.0 Request processed in 37us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851060.757725:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788851060.757768:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb39b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019669376:0@lo:400:kworker.0 00000100:00080000:2.0:1788851060.758284:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851060.758291:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851060.758310:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb39b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019669632:0@lo:400:kworker.0 00000100:00100000:2.0:1788851060.758353:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851060.758405:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb39b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019669120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851060.758930:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019669632 00000100:00100000:3.0:1788851060.758937:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019669632 00000100:00100000:3.0:1788851060.759001:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788851060.759009:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019669632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851060.759056:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019669632:12345-0@lo:400:kworker.0 Request processed in 48us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851060.759062:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788851060.760703:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788851060.760765:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bb39b0a80 x1875746019669632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788851076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851060.760821:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb39b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019669632:0@lo:400:kworker.0 00000100:00100000:1.0:1788851060.767177:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851060.767287:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb39b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019669760:0@lo:400:kworker.0 00000100:00100000:1.0:1788851060.767377:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851060.767529:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019669760 00000100:00100000:3.0:1788851060.767550:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019669760 00000100:00100000:3.0:1788851060.767634:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788851060.767644:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019669760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851060.767730:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019669760:12345-0@lo:400:kworker.0 Request processed in 87us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851060.767739:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788851060.767854:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019669248 00000100:00100000:2.0:1788851060.767860:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019669248 00000100:00100000:2.0:1788851060.767901:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788851060.767909:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019669248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851060.767952:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019669248:12345-0@lo:400:kworker.0 Request processed in 44us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851060.767968:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:1.0:1788851060.768123:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851060.768168:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb39b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019669248:0@lo:400:kworker.0 00000100:00100000:1.0:1788851060.768186:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb39b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019669760:0@lo:400:kworker.0 00000100:00100000:0.0:1788851060.778257:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019669504:12345-0@lo:400:kworker.0 Request processed in 20690us (20981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851060.778274:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788851060.778511:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb39b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019669504:0@lo:400:kworker.0 00000100:00100000:1.0:1788851061.266680:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019669888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851061.266753:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851061.266872:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019669888 00000100:00100000:3.0:1788851061.266889:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019669888 00000100:00100000:3.0:1788851061.266972:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788851061.267102:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019669888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851061.267149:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851061.267246:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019669888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851061.267254:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788851061.267356:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bafcf8700 x1875746019669888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851061.267380:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019669888:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788851061.523639:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851062.548403:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851062.761494:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851062.761620:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000758400 00000100:00100000:2.0:1788851062.761638:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000758400 00000100:00080000:1.0:1788851062.761722:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851062.761758:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 32 00000100:00100000:2.0:1788851062.761774:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:10267:x1875746000758400:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851062.761848:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851062.761879:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879576dda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeab4 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.761969:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576de1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.761986:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576de1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.762003:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576de1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851062.762046:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788851062.762051:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788851062.762101:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576de1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.762131:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879576dda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeab4 expref: 7 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.762176:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576de1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeab4 expref: 6 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.762185:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02300) 00010000:00010000:2.0:1788851062.762189:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851062.762192:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547200, rc 0) 00000100:00100000:2.0:1788851062.762280:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:10267:x1875746000758400:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 510us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851062.762287:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 32 00000100:00100000:3.0:1788851062.772554:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851062.777822:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000758528 00000100:00100000:0.0:1788851062.777842:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000758528 00000100:00100000:0.0:1788851062.778105:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:0.0:1788851062.778119:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:10268:x1875746000758528:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851062.778147:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851062.778171:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576de8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeabb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.778242:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576def lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.778258:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576def lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.778271:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576def lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.778306:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576df6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.778314:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576df6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.778322:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576df6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.778752:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576dfd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.778764:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576dfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.778772:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576dfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851062.778891:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788851062.778895:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788851062.778919:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576dfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.778930:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576def lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.778938:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576def lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.779077:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576def lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.779097:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851062.779102:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576def lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.779110:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576def lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.779123:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02300) 00010000:00010000:0.0:1788851062.779126:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851062.779131:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576def lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.779137:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576def lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.779151:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576df6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.779157:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576df6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.779163:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576df6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.779167:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851062.779170:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576df6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.779175:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576df6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.779192:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a9ba0794900) 00010000:00010000:0.0:1788851062.779195:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851062.779198:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576df6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.779203:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576df6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.779242:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879576de8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeabb expref: 8 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.779257:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576dfd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeabb expref: 7 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851062.779263:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a9ba0794100) 00010000:00010000:0.0:1788851062.779265:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851062.779268:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7800, rc 0) 00000100:00100000:0.0:1788851062.779420:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:10268:x1875746000758528:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 1294us (6866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851062.779430:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:1.0:1788851062.786232:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851062.786283:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851062.786366:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000758784 00000100:00100000:2.0:1788851062.786376:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000758784 00000100:00100000:2.0:1788851062.786536:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 137 00000100:00100000:2.0:1788851062.786548:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37963b51-fe0d-42c0-b479-a7af644fd745+5:2354:x1875746000758784:12345-192.168.204.6@tcp:400:kworker.0 00000100:00080000:1.0:1788851062.786803:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851062.786849:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37963b51-fe0d-42c0-b479-a7af644fd745+5:2354:x1875746000758784:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 303us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851062.786857:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 137 00000100:00100000:3.0:1788851062.786927:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000758656 00000100:00100000:3.0:1788851062.786933:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000758656 00000100:00100000:3.0:1788851062.786970:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 288 00000100:00100000:3.0:1788851062.786979:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2354:x1875746000758656:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851062.787029:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2354:x1875746000758656:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 53us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851062.787036:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 288 00000100:00100000:0.0:1788851062.796651:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851062.796907:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000759040 00000100:00100000:2.0:1788851062.796917:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000759040 00000100:00100000:2.0:1788851062.796982:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:2.0:1788851062.796992:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:10268:x1875746000759040:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851062.797031:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851062.797056:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879576e04 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeac2 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.797131:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576e0b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.797165:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576e0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.797180:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576e0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.797198:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a879576e12 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.797205:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a879576e12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.797212:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a879576e12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798081:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547000/0x7ad3e1a879576e19 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798096:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547000/0x7ad3e1a879576e19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798105:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547000/0x7ad3e1a879576e19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851062.798115:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788851062.798276:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576e0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798285:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576e0b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798293:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576e0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798309:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851062.798314:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576e0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798322:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576e0b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798336:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a9ba0794100) 00010000:00010000:2.0:1788851062.798340:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851062.798345:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576e0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798352:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576e0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798364:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a879576e12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798371:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a879576e12 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798378:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a879576e12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798383:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851062.798385:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a879576e12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798391:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a879576e12 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798479:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a9bbcd02600) 00010000:00010000:2.0:1788851062.798483:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851062.798488:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a879576e12 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.798505:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a879576e12 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.799210:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879576e04 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeac2 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.799232:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547000/0x7ad3e1a879576e19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeac2 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851062.799240:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a9bbcd02f00) 00010000:00010000:2.0:1788851062.799243:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851062.799245:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547000, rc 0) 00000100:00100000:2.0:1788851062.799338:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:10268:x1875746000759040:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 2348us (2697us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788851062.799348:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:1.0:1788851062.815254:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851062.815350:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000759168 00000100:00100000:0.0:1788851062.815360:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000759168 00000100:00100000:2.0:1788851062.815521:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:2.0:1788851062.815543:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:10268:x1875746000759168:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788851062.815676:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:10268:x1875746000759168:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 Request processed in 136us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851062.815684:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 35 00000040:00080000:2.0:1788851063.123572:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788851063.569978:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851064.594408:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851065.345585:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851065.345666:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000759296 00000100:00100000:0.0:1788851065.345684:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000759296 00000100:00100000:0.0:1788851065.345823:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:0.0:1788851065.345838:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:10312:x1875746000759296:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1788851065.345876:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851065.345905:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576e27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeac9 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.345987:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346004:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346019:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346035:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879576e35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346041:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879576e35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346049:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879576e35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346338:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346348:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346355:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346361:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851065.346373:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346382:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346408:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02300) 00010000:00010000:0.0:1788851065.346412:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851065.346418:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346425:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346441:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879576e35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346457:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879576e35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346462:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879576e35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346467:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851065.346470:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879576e35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346476:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879576e35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346483:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a9ba0794900) 00010000:00010000:0.0:1788851065.346486:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851065.346495:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879576e35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346501:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879576e35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788851065.346746:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788851065.346936:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576e27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeac9 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346948:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02300) 00010000:00010000:0.0:1788851065.346950:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851065.346955:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576e27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeac9 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.346967:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6000, rc 0) 00000100:00100000:0.0:1788851065.347062:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:10312:x1875746000759296:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1229us (1508us total) trans 0 rc 301/301 00000100:00100000:0.0:1788851065.347069:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:3.0:1788851065.361253:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851065.361435:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000759552 00000100:00100000:2.0:1788851065.361460:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000759552 00000100:00100000:2.0:1788851065.361560:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 37 00000100:00100000:2.0:1788851065.361575:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:10312:x1875746000759552:12345-192.168.204.6@tcp:36:lfs.0 00010000:00010000:2.0:1788851065.361651:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851065.361686:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576de1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeab4 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851065.361709:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02300) 00010000:00010000:2.0:1788851065.361721:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851065.362085:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879576e3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851065.362102:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879576e3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851065.362114:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879576e3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851065.362127:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576e43 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851065.362134:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576e43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851065.362141:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576e43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851065.392211:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788851065.392236:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879576e3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.392257:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879576e3c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.392265:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879576e3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.392271:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851065.392276:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879576e3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.392284:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879576e3c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.392303:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02600) 00010000:00010000:3.0:1788851065.392306:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851065.392311:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879576e3c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.392316:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879576e3c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851065.392342:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca958e09 reply state 0000000089fbbb81 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576e43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851065.392353:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851065.392511:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+10:10312:x1875746000759552:12345-192.168.204.6@tcp:36:lfs.0 Request processed in 30936us (31272us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788851065.392532:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 37 00010000:00010000:3.0:1788851065.401197:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576e43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.401236:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576e43 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.401245:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576e43 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.401252:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851065.401258:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576e43 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.401267:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576e43 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.401289:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a9bbcd02900) 00010000:00010000:3.0:1788851065.401293:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851065.401298:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576e43 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.401304:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576e43 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851065.463585:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:3.0:1788851065.564547:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851065.564953:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000759680 00000100:00100000:0.0:1788851065.564969:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000759680 00000100:00100000:0.0:1788851065.565058:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:0.0:1788851065.565071:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:10320:x1875746000759680:12345-192.168.204.6@tcp:101:lctl.0 00010000:00010000:0.0:1788851065.565100:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851065.565131:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879576e4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfead0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.565217:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.565233:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.565266:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851065.565313:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788851065.565318:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788851065.565367:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.565397:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879576e4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfead0 expref: 9 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.565420:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfead0 expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.565430:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9ba0794a00) 00010000:00010000:0.0:1788851065.565433:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851065.565437:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6600, rc 0) 00000100:00100000:0.0:1788851065.565527:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:10320:x1875746000759680:12345-192.168.204.6@tcp:101:lctl.0 Request processed in 459us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851065.565535:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 38 00010000:00010000:0.0:1788851065.618410:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851065.700111:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851065.704236:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000759808 00000100:00100000:0.0:1788851065.704259:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000759808 00000100:00100000:3.0:1788851065.707724:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:3.0:1788851065.707744:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:10326:x1875746000759808:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1788851065.707772:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851065.707827:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576e58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfead7 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.707939:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576e5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.707957:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.707972:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.707988:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576e66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.707996:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708004:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708357:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879576e6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708367:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879576e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708375:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879576e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851065.708410:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788851065.708415:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788851065.708475:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879576e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708501:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708508:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576e5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708516:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576e5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708522:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ee00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851065.708526:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576e5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708534:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576e5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708547:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9ba0794a00) 00010000:00010000:3.0:1788851065.708550:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851065.708555:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576e5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708562:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576e5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708577:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708583:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576e66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708590:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576e66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708601:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168fa00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851065.708604:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576e66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708689:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576e66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708699:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8a9b87c2a100) 00010000:00010000:3.0:1788851065.708701:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851065.708704:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576e66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708711:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576e66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708755:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576e58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfead7 expref: 10 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708769:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879576e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfead7 expref: 9 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851065.708776:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:3.0:1788851065.708823:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788851065.708826:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f200, rc 0) 00000100:00100000:3.0:1788851065.708913:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:10326:x1875746000759808:12345-192.168.204.6@tcp:101:bash.0 Request processed in 1174us (8815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851065.708921:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:3.0:1788851065.713967:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851065.714125:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000760064 00000100:00100000:0.0:1788851065.714138:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000760064 00000100:00100000:0.0:1788851065.714210:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 40 00000100:00100000:0.0:1788851065.714223:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:10326:x1875746000760064:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:0.0:1788851065.714248:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851065.714281:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879576e74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeade expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.714907:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576e7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.714926:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576e7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.714940:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576e7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.714958:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576e82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.714966:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576e82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.714972:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576e82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788851065.719324:0:5862:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788851065.721042:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576e89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.721069:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.721084:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.721145:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576e7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.721152:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576e7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.721159:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576e7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.721165:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851065.721170:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576e7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.721178:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576e7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.721192:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851065.721196:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851065.721201:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576e7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.721207:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879576e7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851065.721226:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048a12197 reply state 00000000a0c3c68e transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576e82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851065.721236:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788851065.721283:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879576e74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeade expref: 12 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.721314:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeade expref: 11 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.721322:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199a900) 00010000:00010000:1.0:1788851065.721325:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851065.721327:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58c00, rc 0) 00000100:00100000:1.0:1788851065.721528:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+12:10326:x1875746000760064:12345-192.168.204.6@tcp:101:bash.0 Request processed in 7307us (7574us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788851065.721538:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 40 00010000:00010000:0.0:1788851065.729244:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576e82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.729265:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576e82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.729273:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576e82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.729279:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851065.729285:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576e82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.729315:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576e82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.729334:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9ba0794900) 00010000:00010000:0.0:1788851065.729337:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851065.729341:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576e82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.729348:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879576e82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851065.734047:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851065.734174:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000760192 00000100:00100000:2.0:1788851065.734189:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000760192 00000100:00100000:2.0:1788851065.734245:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:2.0:1788851065.734273:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875746000760192:12345-192.168.204.6@tcp:8:bash.0 00010000:00080000:2.0:1788851065.734313:0:6707:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp t0 exp 0000000000000000 cur 398 last 0 00000020:00000080:2.0:1788851065.734356:0:6707:0:(genops.c:1384:class_connect()) connect: client 3c328062-9d4c-41e6-ae57-f4af3bf37898, cookie 0x7ad3e1a879576e97 00002000:00100000:2.0:1788851065.734370:0:6707:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3c328062-9d4c-41e6-ae57-f4af3bf37898/ffff8a9bb42c5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788851065.734401:0:6707:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788851065.734722:0:6707:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788851065.734760:0:6707:0:(import.c:65:import_set_state_nolock()) ffff8a9bb42c3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851065.734905:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2350:x1875746000760192:12345-192.168.204.6@tcp:8:bash.0 Request processed in 633us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851065.734913:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:3.0:1788851065.742108:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851065.745557:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000760320 00000100:00100000:1.0:1788851065.745579:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000760320 00000100:00100000:2.0:1788851065.747824:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:2.0:1788851065.747845:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:0:x1875746000760320:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:2.0:1788851065.747867:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851065.747900:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a879576e9e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeae5 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788851065.747936:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788851065.747961:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=398s v=(0 0) 00010000:00010000:2.0:1788851065.747966:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851065.747977:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a879576e9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeae5 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851065.748000:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a879576e9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeae5 expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851065.748039:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547200, rc 0) 00000100:00100000:2.0:1788851065.748126:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:0:x1875746000760320:12345-192.168.204.6@tcp:101:bash.0 Request processed in 288us (6035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851065.748134:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00080000:3.0:1788851065.748581:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851065.760023:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851065.760160:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000760448 00000100:00100000:2.0:1788851065.760173:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000760448 00000100:00100000:2.0:1788851065.760309:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:2.0:1788851065.760323:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:10326:x1875746000760448:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:2.0:1788851065.760346:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851065.760370:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeaec expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851065.760411:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a879576e9e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeae5 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851065.760422:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851065.760427:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851065.760433:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851065.760496:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a879576e9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeae5 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851065.760511:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a879576e9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeae5 expref: 8 pid: 6704 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851065.760549:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6707:1875746019670016:192.168.204.6@tcp:104: 00000100:00100000:2.0:1788851065.760677:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788851065.767005:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6707:1875746019670016:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788851065.767061:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851065.767087:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546600, rc 0) 00000100:00100000:0.0:1788851065.767164:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:10326:x1875746000760448:12345-192.168.204.6@tcp:101:bash.0 Request processed in 6843us (7155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851065.767174:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:2.0:1788851065.767362:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851065.770187:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000760576 00000100:00100000:1.0:1788851065.770207:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000760576 00010000:00010000:1.0:1788851065.770275:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a879576e9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeae5 expref: 8 pid: 6704 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851065.770347:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:1.0:1788851065.770360:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2354:x1875746000760576:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851065.770379:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851065.770411:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a879576e9e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeae5 expref: 8 pid: 6704 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.770427:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a879576e9e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeae5 expref: 8 pid: 6704 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.770493:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a879576e9e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeae5 expref: 8 pid: 6704 timeout: 498 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.770516:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851065.770522:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851065.770531:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.770543:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851065.770593:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851065.770611:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5848:1875746019670144:192.168.204.6@tcp:105: 00000100:00100000:1.0:1788851065.770713:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb39ac900 going to sleep for 11 seconds 00000100:00100000:1.0:1788851065.783832:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5848:1875746019670144:192.168.204.6@tcp:105: 00010000:00010000:1.0:1788851065.783876:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851065.784195:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2354:x1875746000760576:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 13835us (16832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851065.784209:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:1.0:1788851065.789160:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851065.789569:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000760832 00000100:00100000:3.0:1788851065.789592:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000760832 00000100:00100000:3.0:1788851065.789754:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:3.0:1788851065.789767:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+11:10326:x1875746000760832:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:3.0:1788851065.790649:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+12:10326:x1875746000760832:12345-192.168.204.6@tcp:35:bash.0 Request processed in 877us (1499us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788851065.790660:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:2.0:1788851065.874832:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019670400:0@lo:400:kworker.0 00000100:00100000:2.0:1788851065.874942:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851065.875012:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019670912:0@lo:400:kworker.0 00000100:00100000:2.0:1788851065.875042:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851065.875079:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788851065.875085:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019670528:0@lo:400:kworker.0 00000100:00100000:2.0:1788851065.875108:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851065.875150:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019670400 00000100:00100000:2.0:1788851065.875160:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019670400 00000100:00100000:3.0:1788851065.875497:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb39b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019671040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851065.875537:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851065.875574:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019671040 00000100:00100000:3.0:1788851065.875578:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019671040 00000100:00100000:3.0:1788851065.875648:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788851065.875659:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019671040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788851065.875704:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851065.875755:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019671040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851065.875763:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788851065.875809:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851065.875854:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb39b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019671040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851065.875906:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019670528 00000100:00100000:3.0:1788851065.875910:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019670528 00000100:00100000:3.0:1788851065.875948:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788851065.875955:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019670528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851065.876015:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019670528:12345-0@lo:400:kworker.0 Request processed in 60us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851065.876021:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1788851065.876038:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851065.876059:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019670528:0@lo:400:kworker.0 00000100:00100000:3.0:1788851065.876103:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019670912 00000100:00100000:3.0:1788851065.876106:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019670912 00000100:00100000:3.0:1788851065.876131:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788851065.876137:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019670912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851065.876172:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019670912:12345-0@lo:400:kworker.0 Request processed in 35us (1129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851065.876178:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788851065.876201:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019670912:0@lo:400:kworker.0 00000100:00100000:1.0:1788851065.876624:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019670656:0@lo:400:kworker.0 00000100:00100000:1.0:1788851065.876672:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851065.876722:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788851065.876734:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019670272:0@lo:400:kworker.0 00000100:00100000:1.0:1788851065.876767:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851065.876818:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019670784:0@lo:400:kworker.0 00000100:00100000:1.0:1788851065.876844:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851065.876873:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019670784 00000100:00100000:1.0:1788851065.876878:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019670784 00000100:00100000:1.0:1788851065.876929:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788851065.876937:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019670784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851065.876980:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019670784:12345-0@lo:400:kworker.0 Request processed in 44us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851065.876987:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788851065.877017:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019670784:0@lo:400:kworker.0 00000100:00100000:1.0:1788851065.878394:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788851065.878422:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019670400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851065.878541:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019670400:12345-0@lo:400:kworker.0 Request processed in 134us (3598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851065.878549:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788851065.879022:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019670272 00000100:00100000:3.0:1788851065.879033:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019670272 00000100:00100000:3.0:1788851065.879096:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788851065.879105:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019670272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851065.879162:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019670272:12345-0@lo:400:kworker.0 Request processed in 59us (2394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851065.879170:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00080000:3.0:1788851065.879223:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851065.879241:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019670656 00000100:00100000:3.0:1788851065.879245:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019670656 00000100:00100000:3.0:1788851065.879283:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788851065.879290:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019670656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851065.879324:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019670656:12345-0@lo:400:kworker.0 Request processed in 35us (2651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851065.879349:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788851065.879363:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851065.879398:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019670272:0@lo:400:kworker.0 00000100:00100000:3.0:1788851065.879416:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019670656:0@lo:400:kworker.0 00000100:00100000:2.0:1788851065.884913:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019670400:0@lo:400:kworker.0 00000100:00100000:1.0:1788851065.928376:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851065.928517:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000761088 00000100:00100000:2.0:1788851065.928531:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000761088 00000100:00100000:2.0:1788851065.928609:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:2.0:1788851065.928623:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+12:10336:x1875746000761088:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1788851065.928655:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851065.928681:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576eac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeaf3 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851065.928857:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788851065.929010:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576eac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaf3 expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851065.929045:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9ba0794a00) 00010000:00010000:2.0:1788851065.929049:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851065.929057:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576eac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaf3 expref: 14 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851065.929074:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546000, rc 0) 00000100:00100000:2.0:1788851065.930353:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:10336:x1875746000761088:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1721us (1980us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788851065.930367:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:2.0:1788851065.936729:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851065.936933:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000761344 00000100:00100000:3.0:1788851065.936945:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000761344 00000100:00100000:3.0:1788851065.937003:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:3.0:1788851065.937014:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:10336:x1875746000761344:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1788851065.937278:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:10336:x1875746000761344:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 264us (560us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788851065.937286:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:1.0:1788851066.056521:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851066.056868:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000761472 00000100:00100000:3.0:1788851066.056883:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000761472 00000100:00100000:3.0:1788851066.056973:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:3.0:1788851066.056987:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:10342:x1875746000761472:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851066.057020:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851066.057050:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576eba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeafa expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.057348:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576ec1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.057367:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.057382:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851066.057531:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788851066.057535:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788851066.057557:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.057594:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576eba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeafa expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.057617:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeafa expref: 15 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.057626:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:3.0:1788851066.057629:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851066.057633:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168fa00, rc 0) 00000100:00100000:3.0:1788851066.057730:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+15:10342:x1875746000761472:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 746us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851066.057739:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:1.0:1788851066.074442:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851066.074553:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000761728 00000100:00100000:3.0:1788851066.074564:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000761728 00000100:00100000:3.0:1788851066.074629:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:3.0:1788851066.074640:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+15:10342:x1875746000761728:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851066.074666:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851066.074691:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576ec8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb01 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.074834:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ecf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.074873:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.074899:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ecf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851066.074913:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788851066.075245:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576ec8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb01 expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.075267:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ecf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb01 expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.075276:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199a900) 00010000:00010000:3.0:1788851066.075279:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851066.075284:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168ee00, rc 0) 00000100:00100000:3.0:1788851066.075360:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:10342:x1875746000761728:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 720us (1375us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788851066.075370:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:0.0:1788851066.086049:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851066.086176:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000762112 00000100:00100000:3.0:1788851066.086188:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000762112 00000100:00100000:3.0:1788851066.086272:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:3.0:1788851066.086285:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:2352:x1875746000762112:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851066.086304:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851066.086337:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ecf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb01 expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.086385:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199a900) 00010000:00010000:3.0:1788851066.086391:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851066.086491:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+16:2352:x1875746000762112:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 208us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851066.086498:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:1.0:1788851066.089683:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851066.091616:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000761984 00000100:00100000:3.0:1788851066.091637:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000761984 00000100:00100000:3.0:1788851066.091739:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:3.0:1788851066.091752:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+16:10342:x1875746000761984:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851066.091821:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851066.091851:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576edd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb08 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.091987:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576ee4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.092005:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.092021:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576ee4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851066.092035:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788851066.092200:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576edd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb08 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.092227:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576ee4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb08 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.092255:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199a900) 00010000:00010000:3.0:1788851066.092258:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788851066.092262:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168e600, rc 0) 00000100:00100000:3.0:1788851066.092343:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:10342:x1875746000761984:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 593us (2674us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788851066.092351:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:2.0:1788851066.104931:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851066.105095:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000762240 00000100:00100000:3.0:1788851066.105110:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000762240 00000100:00100000:3.0:1788851066.105189:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:3.0:1788851066.105201:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2352:x1875746000762240:12345-192.168.204.6@tcp:1:lfs.0 00010000:00010000:3.0:1788851066.105261:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879576ef2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.105288:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.105299:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788851066.105304:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851066.105309:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879576ef2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.105355:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.105372:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 7 pid: 6707 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851066.105410:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb39b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1875746019671168:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851066.105542:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851066.113930:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb39b3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1875746019671168:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851066.113975:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879576ef2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851066.116035:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851066.116179:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000762368 00000100:00100000:1.0:1788851066.116192:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000762368 00002000:00100000:1.0:1788851066.116260:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8a9baf4d0380 x1875746000762368/t0(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:132/0 lens 504/0 e 0 to 0 dl 1788851077 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788851066.116297:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9baf4d0380 with x1875746000762368 ext(0->12) 00010000:00010000:1.0:1788851066.116309:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 8 pid: 6707 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.116330:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 8 pid: 6707 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851066.116340:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a9baf4d0380 00000100:00100000:1.0:1788851066.116382:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:1.0:1788851066.116394:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2352:x1875746000762368:12345-192.168.204.6@tcp:4:lfs.0 00000001:00100000:2.0:1788851066.248307:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c328062-9d4c-41e6-ae57-f4af3bf37898 00000100:00100000:3.0:1788851066.252056:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:2352:x1875746000762368:12345-192.168.204.6@tcp:4:lfs.0 Request processed in 135649us (136020us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788851066.252082:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 0 00002000:00100000:3.0:1788851066.252104:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8a9baf4d0380 x1875746000762368/t4294967299(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:132/0 lens 504/448 e 0 to 0 dl 1788851077 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851066.252118:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9baf4d0380 with x1875746000762368 ext(0->12) 00010000:00010000:3.0:1788851066.252132:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 9 pid: 6707 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.252160:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 9 pid: 6707 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851066.252170:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a9baf4d0380 00000100:00100000:0.0:1788851066.260684:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851066.261550:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000762496 00000100:00100000:2.0:1788851066.261565:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000762496 00010000:00010000:2.0:1788851066.261625:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 9 pid: 6707 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851066.261683:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:2.0:1788851066.261695:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:2354:x1875746000762496:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851066.261713:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788851066.261737:0:6721:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788851066.261741:0:6721:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788851065 00002000:00010000:2.0:1788851066.261743:0:6721:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788851065 00002000:00010000:2.0:1788851066.261746:0:6721:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788851065 00010000:00010000:2.0:1788851066.261771:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 9 pid: 6707 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.261831:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 9 pid: 6707 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.261864:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1c2d2de/0x7ad3e1a879576ea5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaec expref: 9 pid: 6707 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.262020:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788851066.262026:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788851066.262033:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879576ef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.262045:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879576ef2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.262085:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851066.263035:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2354:x1875746000762496:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 1335us (2361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851066.263049:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 36 00010000:00010000:3.0:1788851066.264243:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879576ef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.264264:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879576ef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.264328:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879576ef2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.264338:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879576ef2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.264346:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879576ef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.264354:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f000 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851066.264360:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879576ef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.264369:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879576ef2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.264397:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879576ef2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.264405:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879576ef2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851066.264531:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2352:x1875746000762240:12345-192.168.204.6@tcp:1:lfs.0 Request processed in 159328us (159611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851066.264542:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:1.0:1788851066.272694:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851066.272833:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000762752 00000100:00100000:2.0:1788851066.272849:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000762752 00000100:00100000:2.0:1788851066.272941:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:2.0:1788851066.272955:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:10342:x1875746000762752:12345-192.168.204.6@tcp:35:lfs.0 00000004:00010000:2.0:1788851066.273045:0:5864:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576ee4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb08 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851066.273874:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788851066.274596:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788851066.278250:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788851066.278391:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576ef9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.278420:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576e89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeade expref: 22 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.278440:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576ef9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.278498:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeade expref: 22 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.278521:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576e89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeade expref: 22 pid: 5862 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851066.278539:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1875746019671296:192.168.204.6@tcp:104: 00000100:00100000:2.0:1788851066.278676:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9600 going to sleep for 11 seconds 00000100:00100000:2.0:1788851066.283929:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851066.284148:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000762880 00000100:00100000:3.0:1788851066.284162:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000762880 00010000:00010000:3.0:1788851066.284229:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576e89 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeade expref: 23 pid: 5862 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851066.284278:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 37 00000100:00100000:3.0:1788851066.284290:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:2354:x1875746000762880:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851066.284308:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851066.284315:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576e89 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeade expref: 23 pid: 5862 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.284330:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576e89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeade expref: 23 pid: 5862 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.284355:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199a900) 00010000:00010000:3.0:1788851066.284361:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576ef9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.284370:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.284377:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576ef9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.284398:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851066.284483:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:2354:x1875746000762880:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 195us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851066.284492:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 37 00010000:00010000:0.0:1788851066.284940:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879576e89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeade expref: 22 pid: 5862 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851066.284965:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1875746019671296:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788851066.284994:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851066.285023:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851066.285030:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788851066.285211:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788851066.285454:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788851066.285585:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875746019671424:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788851066.286418:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851066.286505:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc1a42c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851066.286540:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019671424 00000100:00100000:2.0:1788851066.286553:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019671424 00000100:00100000:2.0:1788851066.286616:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788851066.286626:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1875746019671424:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788851066.286750:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1875746019671424:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 125us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851066.286775:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788851066.288898:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875746019671424:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788851066.289939:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788851066.290051:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb39b3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875746019671552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788851066.290142:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851066.290179:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b9864dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788851066.290390:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019671552 00000100:00100000:2.0:1788851066.290400:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019671552 00000100:00100000:2.0:1788851066.290479:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788851066.290492:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1875746019671552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788851066.290709:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5864:x1875746019671552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 220us (566us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788851066.290718:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788851066.292216:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb39b3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875746019671552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788851066.292345:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788851066.292419:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576ef9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.292447:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576ef9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.292457:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576ef9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.292463:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851066.292470:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576ef9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.292479:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576ef9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.292498:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199a900) 00010000:00010000:3.0:1788851066.292500:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788851066.292505:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576ef9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.292511:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576ef9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788851066.292838:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788851066.293157:0:5864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788851066.293176:0:5864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399234393990ns, next at 400234390676ns, rc = 0 00000001:00080000:3.0:1788851066.293186:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788851066.293232:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199a900) 00010000:00010000:3.0:1788851066.293236:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788851066.293246:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576ee4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb08 expref: 26 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851066.293404:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+25:10342:x1875746000762752:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 20451us (20725us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788851066.293415:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00000020:00080000:3.0:1788851066.293424:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788851066.298544:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851066.299373:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000763008 00000100:00100000:1.0:1788851066.299391:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000763008 00000100:00100000:1.0:1788851066.299479:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00100000:1.0:1788851066.299490:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+25:10342:x1875746000763008:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851066.299521:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851066.299551:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879576f00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb0f expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.299619:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879576f00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb0f expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.299635:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879576f00 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb0f expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.300363:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851066.300370:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788851066.300374:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59e00, rc 0) 00000100:00100000:1.0:1788851066.300537:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:10342:x1875746000763008:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1046us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851066.300545:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00100000:2.0:1788851066.309585:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851066.309738:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000763264 00000100:00100000:3.0:1788851066.309752:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000763264 00000100:00100000:3.0:1788851066.309895:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:3.0:1788851066.309907:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b912ac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:10342:x1875746000763264:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1788851066.310213:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b912ac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+27:10342:x1875746000763264:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 308us (654us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788851066.310221:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:0.0:1788851066.387067:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788851066.387101:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019671680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851066.387212:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851066.387758:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019671680 00000100:00100000:1.0:1788851066.387770:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019671680 00000100:00100000:1.0:1788851066.387869:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788851066.387893:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875746019671680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851066.387922:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851066.387995:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875746019671680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851066.388003:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788851066.388149:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019671680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851066.392098:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851066.392162:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000763520 00000100:00100000:3.0:1788851066.392175:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000763520 00000100:00100000:3.0:1788851066.392259:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:3.0:1788851066.392270:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+27:10352:x1875746000763520:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851066.392302:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851066.392330:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576f07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb16 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851066.392489:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788851066.392772:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576f07 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb16 expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.392974:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9ba0794a00) 00010000:00010000:3.0:1788851066.392978:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851066.392985:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576f07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb16 expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.393004:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168e600, rc 0) 00000100:00100000:3.0:1788851066.393091:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+28:10352:x1875746000763520:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 823us (1010us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788851066.393099:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:2.0:1788851066.397128:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851066.397214:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000763648 00000100:00100000:3.0:1788851066.397225:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000763648 00000100:00100000:3.0:1788851066.397288:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:3.0:1788851066.397298:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+28:10352:x1875746000763648:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:3.0:1788851066.397386:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576f15 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397417:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576f15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397440:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576f15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397456:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576f1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397471:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397478:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397581:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397589:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397596:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851066.397654:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397668:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576f15 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397675:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576f15 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397683:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576f15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397689:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851066.397694:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576f15 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397702:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576f15 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397720:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:3.0:1788851066.397723:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851066.397729:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576f15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397736:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576f15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397751:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397757:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576f1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397762:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576f1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397768:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ee00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851066.397770:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576f1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397776:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576f1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397815:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9b87c2a100) 00010000:00010000:3.0:1788851066.397817:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851066.397820:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576f1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397825:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576f1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397854:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397860:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f23 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397867:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397871:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851066.397874:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397879:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f23 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397886:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851066.397888:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851066.397890:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f23 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.397896:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851066.397984:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+28:10352:x1875746000763648:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 686us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851066.397992:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:2.0:1788851066.402908:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851066.403114:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000763904 00000100:00100000:3.0:1788851066.403127:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000763904 00000100:00100000:3.0:1788851066.403236:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:3.0:1788851066.403264:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+28:10352:x1875746000763904:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1788851066.403583:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+29:10352:x1875746000763904:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 321us (691us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788851066.403592:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:2.0:1788851066.444198:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851066.444485:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000764160 00000100:00100000:1.0:1788851066.444499:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000764160 00000100:00100000:1.0:1788851066.444588:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:1.0:1788851066.444600:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+29:10355:x1875746000764160:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851066.444630:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851066.444659:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879576f2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb1d expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.444762:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576f31 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.444778:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576f31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.444836:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576f31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.444856:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576f38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.444864:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.444871:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445038:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879576f3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445048:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879576f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445056:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879576f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851066.445069:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788851066.445210:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576f31 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445219:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576f31 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445227:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576f31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445233:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851066.445245:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576f31 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445255:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576f31 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445270:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851066.445273:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851066.445279:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576f31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445287:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576f31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445305:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445312:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576f38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445318:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576f38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445324:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851066.445327:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576f38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445333:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576f38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445341:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9b9199a000) 00010000:00010000:1.0:1788851066.445344:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851066.445354:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576f38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445361:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879576f38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445421:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879576f2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb1d expref: 32 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445449:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879576f3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb1d expref: 31 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.445457:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851066.445460:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851066.445462:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59600, rc 0) 00000100:00100000:1.0:1788851066.445620:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+31:10355:x1875746000764160:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1022us (1436us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788851066.445628:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:2.0:1788851066.453422:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851066.453527:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000764288 00000100:00100000:3.0:1788851066.453541:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000764288 00000100:00100000:3.0:1788851066.453627:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:3.0:1788851066.453639:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+31:10355:x1875746000764288:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:3.0:1788851066.453726:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.453748:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.453762:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.454161:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.454171:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.454178:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.454185:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851066.454190:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.454199:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.454231:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:2.0:1788851066.454234:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851066.454240:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851066.454246:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879576f4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851066.454348:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+31:10355:x1875746000764288:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 710us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851066.454356:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:2.0:1788851066.458196:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851066.458296:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000764544 00000100:00100000:0.0:1788851066.458311:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000764544 00000100:00100000:0.0:1788851066.458390:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:0.0:1788851066.458401:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+31:10355:x1875746000764544:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:0.0:1788851066.458741:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+32:10355:x1875746000764544:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 341us (558us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788851066.458751:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 11 00010000:00010000:1.0:1788851066.642770:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851066.843920:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851066.844097:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000764800 00000100:00100000:3.0:1788851066.844111:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000764800 00000100:00100000:3.0:1788851066.844190:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:3.0:1788851066.844203:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+32:10386:x1875746000764800:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:3.0:1788851066.844234:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851066.844262:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576f54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb24 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.844397:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576f5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.844413:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.844450:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851066.844464:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788851066.846755:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576f54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb24 expref: 35 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.846818:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576f5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb24 expref: 34 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.846829:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851066.846832:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851066.846836:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f000, rc 0) 00000100:00100000:3.0:1788851066.846942:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:10386:x1875746000764800:12345-192.168.204.6@tcp:101:cat.0 Request processed in 2740us (3034us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788851066.846952:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:2.0:1788851066.855088:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851066.855154:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851066.855267:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000765184 00000100:00100000:1.0:1788851066.855281:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000765184 00000100:00100000:1.0:1788851066.855372:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:1.0:1788851066.855384:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b86786c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:2352:x1875746000765184:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851066.855405:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851066.855449:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576f5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb24 expref: 34 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.855475:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851066.855496:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851066.855583:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b86786c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+33:2352:x1875746000765184:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 200us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851066.855591:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:0.0:1788851066.856518:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000765056 00000100:00100000:0.0:1788851066.856529:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000765056 00000100:00100000:0.0:1788851066.856588:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:0.0:1788851066.856598:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+33:10386:x1875746000765056:12345-192.168.204.6@tcp:35:cat.0 00000100:00100000:0.0:1788851066.857000:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:10386:x1875746000765056:12345-192.168.204.6@tcp:35:cat.0 Request processed in 402us (1928us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788851066.857020:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:2.0:1788851066.926964:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851066.927097:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000765440 00000100:00100000:1.0:1788851066.927111:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000765440 00000100:00100000:1.0:1788851066.927195:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:1.0:1788851066.927208:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:10392:x1875746000765440:12345-192.168.204.6@tcp:101:dd.0 00010000:00010000:1.0:1788851066.927239:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851066.927243:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788851066.927276:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576ec1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeafa expref: 34 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.927301:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851066.927307:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851066.927324:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576f69 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb2b expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.927475:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.927492:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879576f3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb1d expref: 34 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.927502:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.927545:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879576f3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb1d expref: 34 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.927584:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879576f3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb1d expref: 34 pid: 8079 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851066.927602:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019671808:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851066.927741:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8da53d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788851066.936291:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851066.936443:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000765568 00000100:00100000:0.0:1788851066.936456:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000765568 00010000:00010000:0.0:1788851066.936508:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879576f3f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb1d expref: 35 pid: 8079 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851066.936557:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:0.0:1788851066.936569:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+35:2354:x1875746000765568:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851066.936587:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851066.936596:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879576f3f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb1d expref: 35 pid: 8079 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851066.936612:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879576f3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb1d expref: 35 pid: 8079 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851066.936638:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:0.0:1788851066.936644:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851066.936655:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851066.936664:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851066.936688:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851066.936757:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+35:2354:x1875746000765568:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 190us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851066.936823:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 38 00010000:00010000:3.0:1788851066.937176:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879576f3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb1d expref: 34 pid: 8079 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851066.937199:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019671808:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851066.937224:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.937235:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.937242:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851066.937273:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788851066.937507:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879576f69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb2b expref: 35 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.937525:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb2b expref: 34 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851066.937533:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851066.937535:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788851066.937538:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58800, rc 0) 00000100:00100000:3.0:1788851066.937580:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:10392:x1875746000765440:12345-192.168.204.6@tcp:101:dd.0 Request processed in 10375us (10635us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788851066.937587:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:1.0:1788851066.944259:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851066.944369:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000765824 00000100:00100000:0.0:1788851066.944383:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000765824 00000100:00100000:0.0:1788851066.944469:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:0.0:1788851066.944482:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:10392:x1875746000765824:12345-192.168.204.6@tcp:36:dd.0 00010000:00010000:0.0:1788851066.944892:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a879576f7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851066.944914:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a879576f7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851066.944928:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a879576f7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788851066.944994:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788851066.945026:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd0823e5 reply state 00000000165212e5 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a879576f7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851066.945036:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788851066.945972:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+37:10392:x1875746000765824:12345-192.168.204.6@tcp:36:dd.0 Request processed in 1485us (1722us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788851066.945984:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 52 00000020:00080000:0.0:1788851066.945991:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788851066.956447:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a879576f7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.956474:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a879576f7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.956484:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a879576f7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.956491:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851066.956498:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a879576f7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.956507:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a879576f7e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.956528:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851066.956532:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851066.956538:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a879576f7e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851066.956544:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a879576f7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851067.270260:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851067.270600:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000765952 00000100:00100000:2.0:1788851067.270614:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000765952 00000100:00080000:3.0:1788851067.270703:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851067.270718:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:2.0:1788851067.270733:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+36:10406:x1875746000765952:12345-192.168.204.6@tcp:101:stat.0 00010000:00010000:2.0:1788851067.270764:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851067.270835:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879576f85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb32 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.270926:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576f8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.270945:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576f8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.271003:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576f8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.271024:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576f93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.271033:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.271040:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.271154:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576f9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.271168:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb2b expref: 37 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.271177:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576f9a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.271217:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb2b expref: 37 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.271233:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb2b expref: 37 pid: 5862 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851067.271248:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a5b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019671936:192.168.204.6@tcp:104: 00000100:00100000:2.0:1788851067.271398:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788851067.285242:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851067.285362:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a5b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019671936:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851067.285400:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576f9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851067.285941:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000766208 00000100:00100000:0.0:1788851067.285953:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000766208 00000100:00100000:0.0:1788851067.286087:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:0.0:1788851067.286100:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+38:5604:x1875746000766208:12345-192.168.204.6@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788851067.286774:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+39:5604:x1875746000766208:12345-192.168.204.6@tcp:35:ldlm_bl.0 Request processed in 673us (1542us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788851067.286847:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:0.0:1788851067.298519:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851067.299710:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000766336 00000100:00100000:1.0:1788851067.299727:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000766336 00010000:00010000:1.0:1788851067.299825:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb2b expref: 39 pid: 5862 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851067.300058:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:1.0:1788851067.300071:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+39:2354:x1875746000766336:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851067.300090:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851067.300098:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb2b expref: 39 pid: 5862 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.300113:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb2b expref: 39 pid: 5862 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.300141:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576f70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb2b expref: 39 pid: 5862 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.300163:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851067.300168:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576f9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.300179:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.300186:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576f9a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.300257:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851067.300346:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+38:2354:x1875746000766336:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 277us (1841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851067.300353:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 39 00010000:00010000:3.0:1788851067.300438:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300448:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851067.300511:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788851067.300516:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788851067.300583:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300599:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576f9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300622:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576f8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300629:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576f8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300637:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576f8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300644:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851067.300648:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576f8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300664:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576f8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300675:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:3.0:1788851067.300678:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851067.300682:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576f8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300688:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879576f8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300700:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300706:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576f93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300712:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300722:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851067.300725:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300731:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576f93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300738:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9bbcd02c00) 00010000:00010000:3.0:1788851067.300740:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851067.300743:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576f93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300748:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879576f93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300836:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879576f85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb32 expref: 38 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300852:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576f9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb32 expref: 37 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.300869:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851067.300872:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851067.300874:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546a00, rc 0) 00000100:00100000:3.0:1788851067.300907:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf043b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+37:10406:x1875746000765952:12345-192.168.204.6@tcp:101:stat.0 Request processed in 30179us (30662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851067.300915:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:1.0:1788851067.427210:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851067.430494:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000766592 00000100:00100000:3.0:1788851067.430536:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000766592 00000100:00100000:1.0:1788851067.430726:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:1.0:1788851067.430744:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+37:10412:x1875746000766592:12345-192.168.204.6@tcp:36:truncate.0 00010000:00010000:1.0:1788851067.430888:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851067.430925:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879576f9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb32 expref: 37 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.430953:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851067.430959:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851067.431232:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576fa1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.431248:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576fa1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.431259:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576fa1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788851067.431320:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788851067.431350:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000071ce74e5 reply state 000000001ed85c52 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576fa1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851067.431360:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788851067.431526:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+39:10412:x1875746000766592:12345-192.168.204.6@tcp:36:truncate.0 Request processed in 787us (4330us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788851067.431542:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 54 00000020:00080000:1.0:1788851067.431548:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788851067.438366:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576fa1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.438398:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576fa1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.438416:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576fa1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.438423:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851067.438430:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576fa1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.438439:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576fa1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.438459:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851067.438462:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851067.438468:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576fa1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.438475:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576fa1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851067.666143:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851067.669928:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851067.680002:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000766720 00000100:00100000:3.0:1788851067.680024:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000766720 00000100:00100000:3.0:1788851067.680116:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:3.0:1788851067.680129:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+38:10426:x1875746000766720:12345-192.168.204.6@tcp:101:stat.0 00010000:00010000:3.0:1788851067.680160:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851067.680198:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576fa8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb39 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680305:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576faf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680321:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576faf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680334:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576faf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680351:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576fb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680359:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680366:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680487:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576fbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680496:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680504:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851067.680557:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1788851067.680563:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788851067.680586:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680611:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680620:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576faf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680628:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576faf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680635:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576faf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680642:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168e600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851067.680647:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576faf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680656:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576faf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680669:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:3.0:1788851067.680672:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851067.680678:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576faf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680685:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879576faf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680701:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680708:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576fb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680721:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680726:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168fa00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851067.680730:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680736:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680744:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9b87c2a100) 00010000:00010000:3.0:1788851067.680747:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851067.680750:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576fb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680756:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879576fb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680847:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576fa8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb39 expref: 40 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680864:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576fbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb39 expref: 39 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.680872:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851067.680875:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851067.680878:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f000, rc 0) 00000100:00100000:3.0:1788851067.680967:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+39:10426:x1875746000766720:12345-192.168.204.6@tcp:101:stat.0 Request processed in 840us (11054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851067.680984:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:0.0:1788851067.749413:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851067.749544:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000766976 00000100:00100000:1.0:1788851067.749556:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000766976 00000100:00100000:1.0:1788851067.749752:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:1.0:1788851067.749766:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+39:10436:x1875746000766976:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851067.749825:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851067.749860:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576fc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb40 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851067.749954:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788851067.750100:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576fc4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb40 expref: 41 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.750128:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9ba0794a00) 00010000:00010000:1.0:1788851067.750131:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788851067.750137:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879576fc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb40 expref: 41 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.750153:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58800, rc 0) 00000100:00100000:1.0:1788851067.750223:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+40:10436:x1875746000766976:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 461us (832us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788851067.752722:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:2.0:1788851067.755608:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851067.756898:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000767232 00000100:00100000:3.0:1788851067.756913:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000767232 00000100:00100000:3.0:1788851067.756992:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:3.0:1788851067.757001:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+40:10436:x1875746000767232:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1788851067.757278:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+41:10436:x1875746000767232:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 277us (1679us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788851067.757287:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:3.0:1788851067.856051:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851067.856817:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000767488 00000100:00100000:2.0:1788851067.856828:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000767488 00000100:00100000:2.0:1788851067.857372:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:2.0:1788851067.857386:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+41:10442:x1875746000767488:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:2.0:1788851067.857427:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851067.857451:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576fd2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb47 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.857558:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.857586:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576fbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb39 expref: 42 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.857597:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.857637:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576fbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb39 expref: 42 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.857651:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576fbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb39 expref: 42 pid: 5862 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851067.857665:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019672064:192.168.204.6@tcp:104: 00000100:00100000:2.0:1788851067.857806:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788851067.868481:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851067.868603:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a5ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019672064:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851067.868633:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851067.869062:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000767616 00000100:00100000:3.0:1788851067.869070:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000767616 00010000:00010000:3.0:1788851067.869111:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576fbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb39 expref: 43 pid: 5862 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851067.869154:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 40 00000100:00100000:3.0:1788851067.869163:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+43:2353:x1875746000767616:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851067.869207:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851067.869215:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576fbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb39 expref: 43 pid: 5862 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.869229:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576fbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb39 expref: 43 pid: 5862 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.869254:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576fbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb39 expref: 43 pid: 5862 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.869283:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851067.869289:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.869300:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.869310:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.869345:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851067.869451:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+42:2353:x1875746000767616:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 287us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851067.869459:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 40 00010000:00010000:2.0:1788851067.874066:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.874084:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851067.874111:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788851067.874299:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576fd2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb47 expref: 43 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.874323:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb47 expref: 42 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.874332:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:2.0:1788851067.874335:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788851067.874339:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546600, rc 0) 00000100:00100000:2.0:1788851067.874413:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+42:10442:x1875746000767488:12345-192.168.204.6@tcp:101:bash.0 Request processed in 17030us (18371us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788851067.874423:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:0.0:1788851067.885725:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851067.885999:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000767872 00000100:00100000:2.0:1788851067.886011:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000767872 00000100:00100000:2.0:1788851067.886076:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:2.0:1788851067.886087:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+42:10442:x1875746000767872:12345-192.168.204.6@tcp:36:bash.0 00010000:00010000:2.0:1788851067.886416:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576fe7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.886435:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851067.886448:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851067.886500:0:8079:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788851067.886525:0:8079:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f51d0c06 reply state 0000000006d6bb64 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851067.886534:0:8079:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788851067.886642:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+45:10442:x1875746000767872:12345-192.168.204.6@tcp:36:bash.0 Request processed in 557us (926us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788851067.886650:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 58 00000020:00080000:2.0:1788851067.886655:0:8079:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788851067.893429:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851067.893512:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000768000 00000100:00100000:3.0:1788851067.893522:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000768000 00000100:00100000:3.0:1788851067.893585:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:3.0:1788851067.893595:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+45:10442:x1875746000768000:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1788851067.893625:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851067.893647:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576fee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb4e expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.893762:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ff5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.895166:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb47 expref: 46 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.895201:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576fe7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851067.895209:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ff5 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.897440:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576fe7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.897603:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576fe7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.897612:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576fe7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.897620:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851067.897626:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576fe7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.897637:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576fe7 lrc: 5/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.897658:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851067.897661:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851067.897665:0:3294:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ff5 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851067.897677:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576fe7 lrc: 3/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851067.904711:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576fe7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851067.904733:0:5862:0:(ldlm_request.c:1774:ldlm_cli_cancel()) ### lock is already being destroyed 00010000:00010000:0.0:1788851067.904737:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879576fe7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851067.904839:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb47 expref: 45 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851067.904867:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb47 expref: 45 pid: 5863 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851067.904885:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019672192:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851067.905006:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc1a423c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851067.907458:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851067.907619:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851067.907632:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000768128 00000100:00100000:1.0:1788851067.907642:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000768128 00000100:00100000:3.0:1788851067.907650:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851067.907673:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000768256 00000100:00100000:3.0:1788851067.907676:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000768256 00000100:00100000:1.0:1788851067.907695:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 290 00000100:00100000:1.0:1788851067.907704:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2352:x1875746000768128:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851067.907709:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 66 00000100:00100000:3.0:1788851067.907715:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2352:x1875746000768256:12345-192.168.204.6@tcp:400:kworker.0 00000100:00080000:2.0:1788851067.907842:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851067.908052:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000768384 00000100:00100000:3.0:1788851067.908057:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000768384 00000100:00100000:3.0:1788851067.908091:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 141 00000100:00100000:3.0:1788851067.908098:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37963b51-fe0d-42c0-b479-a7af644fd745+5:2352:x1875746000768384:12345-192.168.204.6@tcp:400:kworker.0 00000100:00080000:2.0:1788851067.908150:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851067.908176:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2352:x1875746000768256:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 459us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851067.908183:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 66 00000100:00100000:1.0:1788851067.908562:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2352:x1875746000768128:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 857us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851067.908571:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 290 00000100:00100000:0.0:1788851067.913696:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:37963b51-fe0d-42c0-b479-a7af644fd745+5:2352:x1875746000768384:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 5585us (6063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851067.913712:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 141 00000100:00100000:0.0:1788851067.914126:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019672192:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788851067.914152:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ff5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851067.914312:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851067.914433:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000768512 00000100:00100000:0.0:1788851067.914441:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000768512 00010000:00010000:0.0:1788851067.914471:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb47 expref: 46 pid: 5863 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851067.914506:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:0.0:1788851067.914516:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+46:2354:x1875746000768512:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851067.914530:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851067.914538:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb47 expref: 46 pid: 5863 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851067.914551:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb47 expref: 46 pid: 5863 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851067.914574:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879576fd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb47 expref: 46 pid: 5863 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851067.914603:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:0.0:1788851067.914608:0:6721:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ff5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851067.914620:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851067.914628:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ff5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851067.914652:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851067.914692:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+45:2354:x1875746000768512:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 177us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851067.914700:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 41 00010000:00010000:0.0:1788851067.914737:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851067.914745:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851067.914805:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788851067.914810:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788851067.914833:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851067.914863:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879576fee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb4e expref: 45 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851067.914881:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb4e expref: 44 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851067.914889:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:0.0:1788851067.914892:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851067.914894:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168ee00, rc 0) 00000100:00100000:0.0:1788851067.914920:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+44:10442:x1875746000768000:12345-192.168.204.6@tcp:101:bash.0 Request processed in 21327us (21503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851067.914942:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:0.0:1788851067.924214:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851067.924290:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000768768 00000100:00100000:3.0:1788851067.924301:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000768768 00000100:00100000:3.0:1788851067.924368:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:3.0:1788851067.924380:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b912ae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+44:10442:x1875746000768768:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:3.0:1788851067.925213:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b912ae050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+45:10442:x1875746000768768:12345-192.168.204.6@tcp:35:bash.0 Request processed in 832us (1005us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788851067.925223:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:1.0:1788851068.020199:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851068.020465:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000769024 00000100:00100000:2.0:1788851068.020475:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000769024 00000100:00100000:2.0:1788851068.020539:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:2.0:1788851068.020550:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+45:10452:x1875746000769024:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1788851068.020589:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851068.020622:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879576ffc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb55 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851068.020730:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788851068.020887:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879576ffc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb55 expref: 47 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851068.020904:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9ba0794a00) 00010000:00010000:2.0:1788851068.020907:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851068.020914:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879576ffc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb55 expref: 47 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851068.020929:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546c00, rc 0) 00000100:00100000:2.0:1788851068.021007:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+46:10452:x1875746000769024:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 458us (819us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788851068.021015:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:0.0:1788851068.025488:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851068.025583:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000769152 00000100:00100000:1.0:1788851068.025593:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000769152 00000100:00100000:1.0:1788851068.025650:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:1.0:1788851068.025659:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+46:10452:x1875746000769152:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:1.0:1788851068.025757:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957700a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.025776:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957700a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.025815:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957700a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.025831:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577011 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.025839:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.025845:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.025939:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577018 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.025947:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.025962:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851068.026003:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026031:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957700a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026038:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957700a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026046:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957700a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026052:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851068.026056:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957700a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026064:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957700a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026075:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851068.026078:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851068.026083:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957700a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026090:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957700a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026102:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026108:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577011 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026114:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026124:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851068.026127:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026133:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577011 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026139:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9b9199a000) 00010000:00010000:1.0:1788851068.026142:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851068.026144:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577011 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026150:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577011 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026163:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577018 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026170:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577018 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026176:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026180:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851068.026183:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577018 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026188:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577018 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026203:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851068.026205:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851068.026209:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577018 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.026214:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577018 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851068.026282:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98daca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+46:10452:x1875746000769152:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 623us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851068.026289:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:0.0:1788851068.032690:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851068.032842:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000769408 00000100:00100000:3.0:1788851068.032865:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000769408 00000100:00100000:3.0:1788851068.032918:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:3.0:1788851068.032927:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+46:10452:x1875746000769408:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1788851068.034368:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+47:10452:x1875746000769408:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 1433us (1679us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788851068.034380:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:2.0:1788851068.086562:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851068.086655:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000769664 00000100:00100000:3.0:1788851068.086665:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000769664 00000100:00100000:3.0:1788851068.086730:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 62 00000100:00100000:3.0:1788851068.086741:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+47:10455:x1875746000769664:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851068.086816:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851068.086851:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a87957701f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb5c expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.086942:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577026 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.086958:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577026 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.086973:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577026 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.086989:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957702d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.086996:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957702d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087003:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957702d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087153:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577034 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087164:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087172:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577034 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851068.087181:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788851068.087291:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577026 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087300:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577026 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087307:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577026 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087312:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168e600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851068.087316:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577026 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087324:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577026 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087336:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:3.0:1788851068.087339:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851068.087345:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577026 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087363:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577026 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087378:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957702d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087384:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957702d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087390:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957702d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087409:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851068.087413:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957702d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087419:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957702d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087428:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9b87c2a100) 00010000:00010000:3.0:1788851068.087430:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851068.087433:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957702d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087439:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957702d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087488:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a87957701f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb5c expref: 50 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087503:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577034 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb5c expref: 49 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.087517:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851068.087520:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851068.087523:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f000, rc 0) 00000100:00100000:3.0:1788851068.087586:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+49:10455:x1875746000769664:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 847us (1034us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788851068.087594:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 62 00000100:00100000:0.0:1788851068.101117:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851068.101189:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851068.101440:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000769920 00000100:00100000:1.0:1788851068.101453:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000769920 00000100:00100000:1.0:1788851068.101542:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:1.0:1788851068.101563:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+49:10455:x1875746000769920:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:1.0:1788851068.101663:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577042 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.101685:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.101700:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.101733:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577042 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.101742:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577042 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.101763:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577042 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.101771:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851068.101776:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577042 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.101830:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577042 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.101845:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851068.101848:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788851068.101866:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577042 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.101873:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577042 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851068.101967:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+49:10455:x1875746000769920:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 407us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851068.101975:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:3.0:1788851068.102462:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000769792 00000100:00100000:3.0:1788851068.102468:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000769792 00000100:00100000:3.0:1788851068.102515:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:3.0:1788851068.102522:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+49:2353:x1875746000769792:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851068.102543:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851068.102573:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577034 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb5c expref: 49 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.102590:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851068.102595:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851068.102625:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+48:2353:x1875746000769792:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 103us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851068.102631:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:0.0:1788851068.108626:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851068.108749:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000770176 00000100:00100000:2.0:1788851068.108763:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000770176 00000100:00100000:2.0:1788851068.108885:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:2.0:1788851068.108897:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+48:10455:x1875746000770176:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1788851068.109274:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+49:10455:x1875746000770176:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 378us (663us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788851068.109283:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 17 00000040:00080000:3.0:1788851068.245837:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788851068.281500:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851068.281612:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000770432 00000100:00100000:3.0:1788851068.281626:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000770432 00000100:00100000:3.0:1788851068.281701:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 64 00000100:00100000:3.0:1788851068.281713:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+49:10473:x1875746000770432:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:3.0:1788851068.281745:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851068.281834:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577049 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb63 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.281982:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577050 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.281999:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.282014:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577050 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851068.282027:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788851068.282202:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577049 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb63 expref: 52 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.282228:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577050 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb63 expref: 51 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851068.282236:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851068.282240:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788851068.282244:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168fa00, rc 0) 00000100:00100000:3.0:1788851068.282315:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:10473:x1875746000770432:12345-192.168.204.6@tcp:101:cat.0 Request processed in 604us (832us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788851068.282324:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 64 00000100:00100000:0.0:1788851068.302132:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851068.302476:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000770560 00000100:00100000:1.0:1788851068.302490:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000770560 00000100:00100000:1.0:1788851068.302735:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 65 00000100:00100000:1.0:1788851068.302748:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:10474:x1875746000770560:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851068.302777:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851068.302838:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a87957705e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb6a expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.302964:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577065 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.302983:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.302998:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851068.303044:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788851068.303049:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788851068.303073:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577065 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.303904:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a87957705e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb6a expref: 53 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.303930:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577065 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb6a expref: 52 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.303941:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851068.303944:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788851068.303953:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58e00, rc 0) 00000100:00100000:1.0:1788851068.304048:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:10474:x1875746000770560:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1302us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851068.304056:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 65 00000100:00100000:2.0:1788851068.310717:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851068.310826:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000770944 00000100:00100000:3.0:1788851068.310851:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000770944 00000100:00100000:3.0:1788851068.310928:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:3.0:1788851068.310941:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:10474:x1875746000770944:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1788851068.311399:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+53:10474:x1875746000770944:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 448us (685us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788851068.311408:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:2.0:1788851068.313221:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851068.313335:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000771072 00000100:00100000:0.0:1788851068.313346:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000771072 00000100:00100000:0.0:1788851068.313439:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:0.0:1788851068.313452:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+53:10474:x1875746000771072:12345-192.168.204.6@tcp:103:lfs.0 00010000:00010000:0.0:1788851068.313469:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788851068.313500:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879576ff5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb4e expref: 53 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851068.313527:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb63 expref: 52 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851068.313541:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879576f00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb0f expref: 51 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851068.313552:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:0.0:1788851068.313565:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851068.313647:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+50:10474:x1875746000771072:12345-192.168.204.6@tcp:103:lfs.0 Request processed in 198us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851068.313655:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:0.0:1788851068.322619:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851068.328323:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000771200 00000100:00100000:2.0:1788851068.328346:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000771200 00000100:00100000:2.0:1788851068.328589:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 66 00000100:00100000:2.0:1788851068.328602:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+50:10474:x1875746000771200:12345-192.168.204.6@tcp:58:lfs.0 00010000:00010000:2.0:1788851068.328771:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a87957706c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851068.328812:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a87957706c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851068.328824:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a87957706c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788851068.329189:0:5863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788851068.329464:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788851068.329540:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788851068.329682:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+50:10474:x1875746000771200:12345-192.168.204.6@tcp:58:lfs.0 Request processed in 1080us (7075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851068.329691:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 66 00000100:00100000:1.0:1788851068.359039:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851068.359206:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000771328 00000100:00100000:0.0:1788851068.359221:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000771328 00000100:00100000:0.0:1788851068.359307:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 67 00000100:00100000:0.0:1788851068.359319:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+50:10476:x1875746000771328:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1788851068.359648:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851068.359689:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a879577073 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb71 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851068.359765:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957707a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851068.359842:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957707a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851068.359857:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957707a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851068.359875:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577081 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851068.359886:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851068.359894:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360172:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577088 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360203:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360216:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851068.360267:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788851068.360272:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788851068.360298:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360312:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360322:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957707a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360329:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957707a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360337:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957707a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360343:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851068.360348:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957707a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360356:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957707a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360370:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851068.360374:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851068.360402:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957707a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360409:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957707a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360429:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360435:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577081 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360442:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360447:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851068.360450:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360456:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577081 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360465:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9ba0794900) 00010000:00010000:1.0:1788851068.360467:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851068.360470:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577081 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360476:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577081 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360523:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a879577073 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb71 expref: 52 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360553:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb71 expref: 51 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851068.360561:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02900) 00010000:00010000:1.0:1788851068.360563:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788851068.360565:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59600, rc 0) 00000100:00100000:1.0:1788851068.361263:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:10476:x1875746000771328:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1942us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851068.361274:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 67 00010000:00010000:0.0:1788851068.694411:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788851069.228172:0:12020:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851069.228182:0:12020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851069.228222:0:12020:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788851069.228229:0:12020:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788851069.267157:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788851069.267168:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788851069.267950:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788851069.267959:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788851069.268086:0:11702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb39b2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875746019672320:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788851069.268191:0:11702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb62eb480 going to sleep for 11 seconds 00000100:00100000:3.0:1788851069.271954:0:11702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb39b2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875746019672320:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788851069.281616:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851069.282624:0:5873:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000771456 00000100:00100000:3.0:1788851069.282638:0:5873:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000771456 00000100:00100000:3.0:1788851069.282711:0:5873:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:3.0:1788851069.282724:0:5873:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:10487:x1875746000771456:12345-192.168.204.6@tcp:900:lhsmtool_posix.0 00000100:00080000:1.0:1788851069.282815:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851069.282824:0:5873:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:10487:x1875746000771456:12345-192.168.204.6@tcp:900:lhsmtool_posix.0 Request processed in 104us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851069.282843:0:5873:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:2.0:1788851069.292147:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851069.293067:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000771584 00000100:00100000:3.0:1788851069.293080:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000771584 00000100:00100000:3.0:1788851069.293160:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:3.0:1788851069.293171:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:10487:x1875746000771584:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788851069.293316:0:8079:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788851069.293451:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:10487:x1875746000771584:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 280us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851069.293458:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:3.0:1788851069.296248:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851069.298576:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000771712 00000100:00100000:2.0:1788851069.298592:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000771712 00000100:00100000:2.0:1788851069.298668:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:2.0:1788851069.298679:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:10487:x1875746000771712:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788851069.298764:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957708f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.298801:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957708f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.298830:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957708f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299425:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577096 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299439:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577096 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299522:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577096 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299559:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a87957709d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299568:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a87957709d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299574:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a87957709d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851069.299619:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788851069.299624:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788851069.299639:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a87957709d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299650:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957708f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299657:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957708f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299675:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957708f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299682:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851069.299687:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957708f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299696:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957708f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299709:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a9bbcd02f00) 00010000:00010000:2.0:1788851069.299712:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851069.299717:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957708f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299724:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957708f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299737:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577096 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299743:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577096 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299749:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577096 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299755:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851069.299758:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577096 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.299775:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577096 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.301036:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8a9bbcd02600) 00010000:00010000:2.0:1788851069.301040:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851069.301047:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577096 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.301054:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577096 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.301074:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a87957709d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.301079:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a87957709d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.301086:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a87957709d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.301092:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851069.301095:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a87957709d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.301103:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a87957709d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.301112:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02900) 00010000:00010000:2.0:1788851069.301115:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851069.301118:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a87957709d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.301135:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a87957709d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851069.301245:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:10487:x1875746000771712:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 Request processed in 2562us (5000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851069.301259:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:2.0:1788851069.307812:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851069.310037:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000771968 00000100:00100000:3.0:1788851069.310054:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000771968 00000100:00100000:3.0:1788851069.310124:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00100000:3.0:1788851069.310137:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:10487:x1875746000771968:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851069.310162:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851069.310186:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a8795770a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb78 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.310290:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.310307:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.310320:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851069.310333:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788851069.312638:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.312655:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.312664:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.312671:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851069.312676:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.312700:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.312718:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02900) 00010000:00010000:3.0:1788851069.312721:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851069.312727:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.312734:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.312808:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a8795770a4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb78 expref: 53 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.312819:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a9bbcd02f00) 00010000:00010000:3.0:1788851069.312821:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851069.312825:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a8795770a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb78 expref: 53 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.312834:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f000, rc 0) 00000100:00100000:3.0:1788851069.314879:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:10487:x1875746000771968:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 4736us (7069us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788851069.314892:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00100000:3.0:1788851069.320212:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851069.320303:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000772096 00000100:00100000:0.0:1788851069.320314:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000772096 00000100:00100000:0.0:1788851069.320364:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 71 00000100:00100000:0.0:1788851069.320387:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:10487:x1875746000772096:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788851069.320428:0:5862:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788851069.320592:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:10487:x1875746000772096:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 208us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851069.320608:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 71 00000100:00100000:0.0:1788851069.335620:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851069.335943:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000772352 00000100:00100000:2.0:1788851069.335953:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000772352 00000100:00100000:2.0:1788851069.336011:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 72 00000100:00100000:2.0:1788851069.336021:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:10487:x1875746000772352:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851069.336058:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851069.336061:0:8079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788851069.336091:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577065 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb6a expref: 52 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.336111:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:2.0:1788851069.336116:0:8079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851069.336243:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a8795770b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb7f expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788851069.336755:0:8079:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788851069.338480:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a8795770c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.338501:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a8795770c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.339265:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a8795770c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.339349:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a8795770b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb7f expref: 54 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.339379:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a8795770c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb7f expref: 53 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.339390:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a9bbcd02600) 00010000:00010000:2.0:1788851069.339393:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851069.339397:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546800, rc 0) 00000100:00100000:2.0:1788851069.339471:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+53:10487:x1875746000772352:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 3451us (3858us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788851069.339480:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 72 00000100:00100000:2.0:1788851069.354308:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851069.356666:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000772608 00000100:00100000:1.0:1788851069.356681:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000772608 00000100:00100000:1.0:1788851069.356749:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00100000:1.0:1788851069.356762:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+53:10487:x1875746000772608:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788851069.356856:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851069.356886:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a8795770c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb7f expref: 53 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.356905:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a9bbcd02600) 00010000:00010000:1.0:1788851069.356917:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851069.356939:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795770ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.356965:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795770ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.356977:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795770ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357054:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795770d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf146cc71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357063:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795770d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf146cc71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357070:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795770d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf146cc71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357154:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795770ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357162:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795770ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357170:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795770ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357176:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851069.357181:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795770ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357189:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795770ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357199:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851069.357209:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851069.357215:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795770ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357221:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795770ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357232:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795770d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf146cc71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357238:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795770d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf146cc71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357244:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795770d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf146cc71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357248:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851069.357251:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795770d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf146cc71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357257:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795770d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf146cc71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357263:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf146cc71 (ffff8a9b9199a000) 00010000:00010000:1.0:1788851069.357266:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851069.357268:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795770d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf146cc71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.357273:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795770d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf146cc71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851069.357358:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:10487:x1875746000772608:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 598us (3061us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788851069.357384:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00100000:0.0:1788851069.361612:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851069.361682:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000772736 00000100:00100000:3.0:1788851069.361694:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000772736 00000100:00100000:3.0:1788851069.361751:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 74 00000100:00100000:3.0:1788851069.361762:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:10487:x1875746000772736:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851069.361944:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851069.361970:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a8795770dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb86 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.362010:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.362023:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.362036:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.362134:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a8795770dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb86 expref: 54 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.362152:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb86 expref: 53 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.362162:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:3.0:1788851069.362165:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788851069.362169:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f800, rc 0) 00000100:00100000:3.0:1788851069.362230:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+53:10487:x1875746000772736:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 469us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851069.362237:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 74 00000100:00100000:1.0:1788851069.372039:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851069.372122:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000772992 00000100:00100000:0.0:1788851069.372133:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000772992 00000100:00100000:0.0:1788851069.372200:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 75 00000100:00100000:0.0:1788851069.372211:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+53:10487:x1875746000772992:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788851069.372308:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795770ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.372330:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795770ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.372344:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795770ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851069.372671:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788851069.372682:0:5862:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 402313899537ns, next at 403313897191ns, rc = 0 00000004:00010000:0.0:1788851069.372771:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067cfd064 reply state 0000000075751dad transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795770ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851069.372811:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788851069.372982:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:10487:x1875746000772992:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 771us (950us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788851069.372991:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 75 00010000:00010000:3.0:1788851069.376305:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795770ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.376324:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795770ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.376340:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795770ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.376347:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851069.376353:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795770ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.376361:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795770ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.376393:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:3.0:1788851069.376396:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788851069.376402:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795770ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.376409:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795770ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851069.382232:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851069.382479:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000773120 00000100:00100000:3.0:1788851069.382490:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000773120 00000100:00100000:3.0:1788851069.382554:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 76 00000100:00100000:3.0:1788851069.382564:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:10487:x1875746000773120:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851069.382592:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851069.382616:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a8795770f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb8d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.382679:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a8795770f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb8d expref: 55 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.382718:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a8795770f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb8d expref: 55 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.382740:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:3.0:1788851069.382743:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788851069.382748:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f000, rc 0) 00000100:00100000:3.0:1788851069.382886:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:10487:x1875746000773120:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 323us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851069.382894:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 76 00000100:00100000:1.0:1788851069.391718:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851069.392538:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000773248 00000100:00100000:0.0:1788851069.392552:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000773248 00000100:00100000:0.0:1788851069.392636:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:0.0:1788851069.392646:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875746000773248:12345-192.168.204.6@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788851069.392682:0:6706:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:0.0:1788851069.392718:0:6706:0:(genops.c:1384:class_connect()) connect: client 3c328062-9d4c-41e6-ae57-f4af3bf37898, cookie 0x7ad3e1a8795770f8 00002000:00100000:0.0:1788851069.392733:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3c328062-9d4c-41e6-ae57-f4af3bf37898/ffff8a9bb4016800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788851069.392762:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788851069.394390:0:6706:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788851069.394437:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8a9bb4014000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788851069.394515:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2350:x1875746000773248:12345-192.168.204.6@tcp:8:lhsmtool_posix.0 Request processed in 1867us (2805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851069.394526:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:1.0:1788851069.398658:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851069.398844:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000773376 00000100:00100000:0.0:1788851069.399654:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000773376 00000100:00100000:1.0:1788851069.400896:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:1.0:1788851069.400912:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:0:x1875746000773376:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788851069.401006:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1788851069.458385:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c328062-9d4c-41e6-ae57-f4af3bf37898 00000001:00080000:0.0:1788851069.458409:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1788851069.458579:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:0:x1875746000773376:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 57666us (59923us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788851069.458593:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:0.0:1788851069.461226:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851069.461310:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000773632 00000100:00100000:3.0:1788851069.461320:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000773632 00000100:00100000:3.0:1788851069.461391:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:3.0:1788851069.461402:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:10487:x1875746000773632:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788851069.461673:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:10487:x1875746000773632:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 272us (457us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788851069.461681:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:0.0:1788851069.466000:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851069.466084:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000773888 00000100:00100000:1.0:1788851069.466096:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000773888 00000100:00100000:0.0:1788851069.466437:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 77 00000100:00100000:0.0:1788851069.466450:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:10487:x1875746000773888:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788851069.466598:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:10487:x1875746000773888:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 152us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851069.466605:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 77 00000100:00100000:2.0:1788851069.470888:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851069.470998:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000774016 00000100:00100000:3.0:1788851069.471008:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000774016 00000100:00100000:3.0:1788851069.471060:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 78 00000100:00100000:3.0:1788851069.471071:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:10487:x1875746000774016:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851069.471096:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851069.471120:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a8795770ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb94 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.471201:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.471232:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.471245:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851069.471286:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788851069.471308:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.471337:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a8795770ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb94 expref: 58 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.471357:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb94 expref: 57 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.471378:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:3.0:1788851069.471381:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788851069.471386:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168fa00, rc 0) 00000100:00100000:3.0:1788851069.471452:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:10487:x1875746000774016:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 382us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851069.471460:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 78 00000100:00100000:1.0:1788851069.474546:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851069.474669:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000774144 00000100:00100000:3.0:1788851069.474678:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000774144 00000100:00100000:3.0:1788851069.474736:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 26 00000100:00100000:3.0:1788851069.474746:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2354:x1875746000774144:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851069.474766:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851069.474931:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047a832ad/0x7ad3e1a87957710d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeb9b expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851069.474975:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fb37d, blocks: 0x1 00010000:00010000:3.0:1788851069.474999:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=402s v=(0 0) 00010000:00010000:3.0:1788851069.475005:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851069.475015:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047a832ad/0x7ad3e1a87957710d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb9b expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.475039:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000047a832ad/0x7ad3e1a87957710d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb9b expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.475052:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168ee00, rc 0) 00000100:00100000:3.0:1788851069.475115:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000774144:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 371us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851069.475122:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 26 00000100:00100000:1.0:1788851069.478123:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851069.478281:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000774400 00000100:00100000:3.0:1788851069.478290:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000774400 00000100:00100000:3.0:1788851069.478349:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 79 00000100:00100000:3.0:1788851069.478359:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:10487:x1875746000774400:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788851069.478481:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:10487:x1875746000774400:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 123us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851069.478489:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 79 00000100:00100000:0.0:1788851069.481507:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851069.481606:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000774528 00000100:00100000:2.0:1788851069.481615:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000774528 00000100:00100000:2.0:1788851069.481728:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:2.0:1788851069.481739:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:10487:x1875746000774528:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851069.481761:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851069.481858:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577114 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeba2 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.481911:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000047a832ad/0x7ad3e1a87957710d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb9b expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.481921:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851069.481926:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851069.481932:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577114 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeba2 expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.481979:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000047a832ad/0x7ad3e1a87957710d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb9b expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.481994:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000047a832ad/0x7ad3e1a87957710d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb9b expref: 7 pid: 6704 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851069.482009:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6707:1875746019672448:192.168.204.6@tcp:104: 00000100:00100000:2.0:1788851069.482270:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9480 going to sleep for 11 seconds 00000100:00100000:1.0:1788851069.485320:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851069.485629:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6707:1875746019672448:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851069.485665:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577114 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeba2 expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.485689:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547400, rc 0) 00000100:00100000:2.0:1788851069.485759:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:10487:x1875746000774528:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 4021us (4260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851069.485769:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:3.0:1788851069.487377:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000774656 00000100:00100000:3.0:1788851069.487389:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000774656 00010000:00010000:2.0:1788851069.487605:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000047a832ad/0x7ad3e1a87957710d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb9b expref: 7 pid: 6704 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851069.487691:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:2.0:1788851069.487702:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b906b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2354:x1875746000774656:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851069.487717:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851069.487742:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000047a832ad/0x7ad3e1a87957710d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb9b expref: 7 pid: 6704 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.487756:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000047a832ad/0x7ad3e1a87957710d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb9b expref: 7 pid: 6704 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.487799:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047a832ad/0x7ad3e1a87957710d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb9b expref: 7 pid: 6704 timeout: 502 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.487829:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851069.487834:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851069.487844:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577114 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeba2 expref: 6 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.487856:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577114 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeba2 expref: 6 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.487897:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577114 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeba2 expref: 6 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851069.487931:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a5a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5847:1875746019672576:192.168.204.6@tcp:105: 00000100:00100000:2.0:1788851069.488018:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9480 going to sleep for 11 seconds 00000100:00100000:2.0:1788851069.493377:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a5a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5847:1875746019672576:192.168.204.6@tcp:105: 00010000:00010000:2.0:1788851069.493408:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851069.493466:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b906b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000774656:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 5765us (8154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851069.493476:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:0.0:1788851069.494595:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851069.495319:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000774784 00000100:00100000:3.0:1788851069.495329:0:6713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000774784 00002000:00100000:3.0:1788851069.495389:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8a9bafc90380 x1875746000774784/t0(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:135/0 lens 504/0 e 0 to 0 dl 1788851080 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851069.495415:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bafc90380 with x1875746000774784 ext(0->8) 00002000:00010000:3.0:1788851069.495421:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bafc90380 00000100:00100000:3.0:1788851069.495496:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:3.0:1788851069.495506:0:6713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2352:x1875746000774784:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788851069.496488:0:6713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2352:x1875746000774784:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 Request processed in 979us (1906us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788851069.496529:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 0 00002000:00100000:2.0:1788851069.496540:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8a9bafc90380 x1875746000774784/t4294967302(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:135/0 lens 504/448 e 0 to 0 dl 1788851080 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788851069.496550:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bafc90380 with x1875746000774784 ext(0->8) 00002000:00010000:2.0:1788851069.496554:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bafc90380 00000100:00100000:1.0:1788851069.499096:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851069.499173:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000774912 00000100:00100000:3.0:1788851069.499183:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000774912 00000100:00100000:3.0:1788851069.499239:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 80 00000100:00100000:3.0:1788851069.499249:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:10487:x1875746000774912:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788851069.539951:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:3.0:1788851069.539968:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788851069.540031:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1788851069.540061:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788851069.540076:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a9b9864d180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788851069.540081:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9b98cbe200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a9b9864de40 00000020:00080000:3.0:1788851069.540085:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9b98cbe500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a9b988b1800 00000020:00080000:3.0:1788851069.540215:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788851069.540338:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788851069.540361:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019672704:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788851069.540445:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851069.540710:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:10487:x1875746000774912:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 Request processed in 41459us (41620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851069.540721:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 80 00000100:00100000:2.0:1788851069.540907:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019672832:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788851069.540936:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851069.540970:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019672704 00000100:00100000:2.0:1788851069.540978:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019672704 00000100:00100000:2.0:1788851069.541026:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019672832 00000100:00100000:2.0:1788851069.541030:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019672832 00000100:00100000:2.0:1788851069.541074:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788851069.541082:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019672704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788851069.541251:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788851069.541255:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788851069 00002000:00010000:2.0:1788851069.541258:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788851069.541260:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788851069 -> 1788851069 00002000:00010000:2.0:1788851069.541263:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788851069.541297:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875746019672704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 216us (853us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788851069.541305:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788851069.541319:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788851069.541326:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875746019672832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788851069.541340:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788851069.541378:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9fb379, atime: 0x6a9fb379, ctime: 0x6a9fb379, blocks: 0x1 00010000:00010000:2.0:1788851069.541387:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a87957711b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.541404:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=402s v=(0 0) 00010000:00010000:2.0:1788851069.541409:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851069.541416:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a87957711b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.541433:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a87957711b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.541443:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a87957711b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.541463:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a87957711b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.541482:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788851069.541975:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1875746019672832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 647us (1036us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788851069.541982:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788851069.542003:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788851069.542008:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788851069.542043:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a9bc1a5ad80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788851069.542050:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019672832:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788851069.542077:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a9bb3667480/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788851069.542081:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019672704:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788851069.544755:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851069.544847:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000775040 00000100:00100000:3.0:1788851069.544857:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000775040 00000100:00100000:3.0:1788851069.544907:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 30 00000100:00100000:3.0:1788851069.544916:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2352:x1875746000775040:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788851069.550037:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851069.550057:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a87957711b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.550074:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547200 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851069.550079:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a87957711b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.550093:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a87957711b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.550116:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a87957711b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.550143:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005b1fe06/0x7ad3e1a87957711b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.550168:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851069.550169:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851069.550172:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851069.584758:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2352:x1875746000775040:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 Request processed in 39830us (40001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851069.584879:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 30 00000001:00080000:0.0:1788851069.584922:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1788851069.584930:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1788851069.589018:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851069.589135:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000775296 00000100:00100000:3.0:1788851069.589145:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000775296 00000100:00100000:3.0:1788851069.589199:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 81 00000100:00100000:3.0:1788851069.589209:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:10487:x1875746000775296:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788851069.589265:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851069.589293:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577106 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb94 expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.589313:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:3.0:1788851069.589318:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851069.589346:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577122 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.589361:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.589383:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851069.589629:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f39d1562 reply state 00000000f01331ab transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851069.589640:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851069.590037:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:10487:x1875746000775296:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 827us (1025us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788851069.590045:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 81 00010000:00010000:2.0:1788851069.593991:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577122 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.594010:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577122 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.594018:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577122 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.594026:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168e600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851069.594039:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577122 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.594069:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577122 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.594089:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:2.0:1788851069.594092:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851069.594097:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577122 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.594104:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577122 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851069.597426:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851069.597682:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000775424 00000100:00100000:3.0:1788851069.597692:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000775424 00000100:00100000:3.0:1788851069.597749:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:3.0:1788851069.597810:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000775424:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788851069.598078:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788851069.598083:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788851069 -> 1788851067 00002000:00010000:3.0:1788851069.598085:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788851065 00002000:00010000:3.0:1788851069.598087:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788851069 -> 1788851067 00002000:00010000:3.0:1788851069.598089:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788851069.598148:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000775424:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 371us (734us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788851069.598155:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:3.0:1788851069.601660:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851069.601834:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000775680 00000100:00100000:0.0:1788851069.601843:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000775680 00000100:00100000:0.0:1788851069.601902:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 82 00000100:00100000:0.0:1788851069.601912:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:10487:x1875746000775680:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788851069.601986:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577129 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.602006:0:8079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb86 expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.602016:0:8079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577129 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.602054:0:8079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb86 expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.602068:0:8079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb86 expref: 13 pid: 5863 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851069.602082:0:8079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafc91500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8079:1875746019672960:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851069.602186:0:8079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b91a05180 going to sleep for 11 seconds 00000100:00100000:2.0:1788851069.606103:0:8079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafc91500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8079:1875746019672960:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851069.606134:0:8079:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577129 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851069.608069:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851069.608345:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000775808 00000100:00100000:0.0:1788851069.608354:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000775808 00010000:00010000:0.0:1788851069.608410:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb86 expref: 14 pid: 5863 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851069.608473:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:0.0:1788851069.608484:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:2353:x1875746000775808:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851069.608512:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851069.608520:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb86 expref: 14 pid: 5863 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.608533:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb86 expref: 14 pid: 5863 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.608775:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795770e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb86 expref: 14 pid: 5863 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.608846:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:0.0:1788851069.608853:0:6721:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577129 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.608863:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.608871:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577129 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.608904:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851069.608954:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:2353:x1875746000775808:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 472us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851069.608962:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 43 00010000:00010000:2.0:1788851069.609021:0:8079:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.609031:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.609062:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.609069:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577129 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.609076:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577129 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.609094:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851069.609099:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577129 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.609107:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577129 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.609116:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:2.0:1788851069.609119:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788851069.609123:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577129 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.609129:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577129 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851069.609173:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+12:10487:x1875746000775680:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 Request processed in 7263us (7523us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788851069.609181:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 82 00000100:00100000:0.0:1788851069.612246:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851069.612335:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000775936 00000100:00100000:2.0:1788851069.612343:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000775936 00000100:00100000:2.0:1788851069.612413:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 32 00000100:00100000:2.0:1788851069.612424:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2354:x1875746000775936:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788851069.612475:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000beaccc2d/0x7ad3e1a879577130 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.612496:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577114 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeba2 expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.612525:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851069.612530:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788851069.612534:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000beaccc2d/0x7ad3e1a879577130 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.612584:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577114 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeba2 expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.612599:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577114 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeba2 expref: 7 pid: 6707 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851069.612613:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6707:1875746019673088:192.168.204.6@tcp:104: 00000100:00100000:2.0:1788851069.612705:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788851069.617347:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851069.617614:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6707:1875746019673088:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851069.617646:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000beaccc2d/0x7ad3e1a879577130 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851069.618770:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000776064 00000100:00100000:0.0:1788851069.618982:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000776064 00010000:00010000:0.0:1788851069.619030:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577114 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeba2 expref: 8 pid: 6707 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851069.619165:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:0.0:1788851069.619176:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2354:x1875746000776064:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851069.619194:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851069.619219:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577114 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeba2 expref: 8 pid: 6707 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.619232:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577114 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeba2 expref: 8 pid: 6707 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.619260:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577114 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeba2 expref: 8 pid: 6707 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.619278:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851069.619283:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851069.619289:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000beaccc2d/0x7ad3e1a879577130 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.619299:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000beaccc2d/0x7ad3e1a879577130 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.619336:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851069.619408:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2354:x1875746000776064:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 234us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851069.619432:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 44 00010000:00010000:1.0:1788851069.620054:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000beaccc2d/0x7ad3e1a879577130 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.620067:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000beaccc2d/0x7ad3e1a879577130 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.620105:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000beaccc2d/0x7ad3e1a879577130 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.620115:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000beaccc2d/0x7ad3e1a879577130 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.620123:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000beaccc2d/0x7ad3e1a879577130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.620131:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547a00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851069.620135:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000beaccc2d/0x7ad3e1a879577130 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.620159:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000beaccc2d/0x7ad3e1a879577130 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.620174:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000beaccc2d/0x7ad3e1a879577130 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.620183:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000beaccc2d/0x7ad3e1a879577130 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851069.620255:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000775936:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 Request processed in 7832us (8018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851069.620264:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 32 00000100:00100000:1.0:1788851069.623493:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851069.623774:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000776320 00000100:00100000:2.0:1788851069.623803:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000776320 00000100:00100000:2.0:1788851069.623869:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 83 00000100:00100000:2.0:1788851069.623878:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+12:10487:x1875746000776320:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788851069.623961:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879577137 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.623998:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879577137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.624011:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879577137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.624487:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957713e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.624512:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a8795770f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb8d expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.624521:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957713e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.624619:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a8795770f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb8d expref: 13 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.624634:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a8795770f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb8d expref: 13 pid: 5863 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851069.624649:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a59880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019673216:192.168.204.6@tcp:104: 00000100:00100000:2.0:1788851069.624855:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788851069.627721:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a59880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019673216:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851069.627752:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957713e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851069.630171:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851069.630353:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000776448 00000100:00100000:2.0:1788851069.630386:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000776448 00010000:00010000:2.0:1788851069.630424:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a8795770f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb8d expref: 14 pid: 5863 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851069.630462:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00100000:2.0:1788851069.630471:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:2353:x1875746000776448:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851069.630486:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851069.630493:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a8795770f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb8d expref: 14 pid: 5863 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.630511:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a8795770f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb8d expref: 14 pid: 5863 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.630534:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a8795770f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb8d expref: 14 pid: 5863 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.630557:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:2.0:1788851069.630563:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957713e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.630573:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957713e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.630580:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957713e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.630609:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851069.630653:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:2353:x1875746000776448:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 183us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851069.630677:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 45 00010000:00010000:1.0:1788851069.632116:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957713e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.632132:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957713e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788851069.632326:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788851069.632481:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788851069.632765:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788851069.632957:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baeff0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1875746019673344:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788851069.633016:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851069.633046:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851069.633157:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019673344 00000100:00100000:0.0:1788851069.633164:0:5867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019673344 00000100:00100000:0.0:1788851069.633207:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788851069.633216:0:5867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5862:x1875746019673344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788851069.633302:0:5867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5862:x1875746019673344:12345-0@lo:1000:mdt00_001.0 Request processed in 87us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851069.633309:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788851069.633526:0:5862:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788851069.633532:0:5862:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a9bb3667480, transno 4294967303 00000100:00100000:1.0:1788851069.633558:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baeff0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1875746019673344:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788851069.634967:0:5862:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788851069.635048:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baeff0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1875746019673472:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788851069.635114:0:5862:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851069.635143:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788851069.635302:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019673472 00000100:00100000:0.0:1788851069.635309:0:5867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019673472 00000100:00100000:0.0:1788851069.635346:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851069.635354:0:5867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5862:x1875746019673472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788851069.635775:0:5867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5862:x1875746019673472:12345-0@lo:1000:mdt00_001.0 Request processed in 421us (660us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788851069.635929:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788851069.636009:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baeff0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5862:1875746019673472:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788851069.636045:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957713e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636056:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957713e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636064:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957713e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636071:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851069.636075:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957713e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636084:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957713e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636101:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:1.0:1788851069.636104:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788851069.636109:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957713e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636115:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957713e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636162:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a87957706c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636169:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a87957706c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636174:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a87957706c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636179:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851069.636182:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a87957706c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636187:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a87957706c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636194:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02900) 00010000:00010000:1.0:1788851069.636196:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788851069.636198:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a87957706c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636203:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a87957706c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636221:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577145 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636235:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577088 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb71 expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636244:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577145 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636279:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb71 expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.636293:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577088 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb71 expref: 16 pid: 5862 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851069.636304:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baeff0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019673600:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851069.636423:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788851069.640892:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851069.641002:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baeff0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019673600:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851069.641043:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577145 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851069.641122:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000776576 00000100:00100000:2.0:1788851069.641129:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000776576 00010000:00010000:2.0:1788851069.641168:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577088 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb71 expref: 17 pid: 5862 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851069.641206:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:2.0:1788851069.641216:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:2354:x1875746000776576:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851069.641233:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851069.641240:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577088 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb71 expref: 17 pid: 5862 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.641252:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb71 expref: 17 pid: 5862 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.641276:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577088 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeb71 expref: 17 pid: 5862 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.641291:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02900) 00010000:00010000:2.0:1788851069.641296:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577145 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.641307:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577145 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.641314:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577145 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851069.641357:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851069.641417:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+16:2354:x1875746000776576:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 202us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851069.641425:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 46 00010000:00010000:1.0:1788851069.641477:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577145 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.641485:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577145 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.641498:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577145 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.641504:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577145 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.641510:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577145 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.641516:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851069.641520:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577145 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.641535:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577145 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.641545:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02900) 00010000:00010000:1.0:1788851069.641548:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851069.641553:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577145 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.641558:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577145 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.641568:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879577137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.641574:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879577137 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.641580:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879577137 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.641584:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851069.641587:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879577137 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.641592:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879577137 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.641599:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02900) 00010000:00010000:1.0:1788851069.641601:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788851069.641604:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879577137 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851069.641620:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a879577137 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851069.641874:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+15:10487:x1875746000776320:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 17996us (18391us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788851069.641884:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 83 00000020:00080000:1.0:1788851069.641888:0:5862:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788851069.642171:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788851069.642176:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788851069.642203:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788851069.642209:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788851069.652451:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851069.652541:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000776832 00000100:00100000:3.0:1788851069.652559:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000776832 00000100:00100000:3.0:1788851069.652616:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:3.0:1788851069.652626:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+15:10487:x1875746000776832:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788851069.653411:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788851069.653525:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788851069.653578:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957714c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.653596:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957714c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.653610:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957714c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.653619:0:5864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957714c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.653640:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957714c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.653645:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957714c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851069.653662:0:5864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788851069.653806:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:10487:x1875746000776832:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 1153us (1336us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788851069.653815:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 20 00000020:00080000:3.0:1788851069.653821:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788851069.654417:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851069.654428:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957714c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.654437:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ee00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851069.654441:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957714c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.654450:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957714c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.654465:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:0.0:1788851069.654478:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788851069.654485:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957714c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.654491:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957714c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851069.654511:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851069.654513:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851069.654514:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851069.714096:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851070.739035:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851070.995159:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baeff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019673728:0@lo:400:kworker.0 00000100:00100000:1.0:1788851070.995210:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baeff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019674112:0@lo:400:kworker.0 00000100:00100000:1.0:1788851070.995286:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851070.995329:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851070.995366:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851070.995376:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875746019674240:0@lo:400:kworker.0 00000100:00100000:1.0:1788851070.995419:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851070.995462:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baeff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019673856:0@lo:400:kworker.0 00000100:00100000:1.0:1788851070.995487:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851070.995507:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019674368:0@lo:400:kworker.0 00000100:00100000:3.0:1788851070.995525:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019674240 00000100:00100000:1.0:1788851070.995532:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851070.995536:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019674240 00000100:00100000:1.0:1788851070.995554:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851070.995562:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baeff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019673984:0@lo:400:kworker.0 00000100:00100000:1.0:1788851070.995588:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851070.995600:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019673856 00000100:00100000:3.0:1788851070.995605:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019673856 00000100:00100000:3.0:1788851070.995626:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019673984 00000100:00100000:3.0:1788851070.995628:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019673984 00000100:00100000:1.0:1788851070.995630:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019674112 00000100:00100000:1.0:1788851070.995637:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019674112 00000100:00100000:3.0:1788851070.995649:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788851070.995660:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875746019674240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851070.995674:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019674368 00000100:00100000:1.0:1788851070.995679:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019674368 00000100:00100000:1.0:1788851070.995714:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788851070.995724:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875746019674112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851070.995730:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875746019674240:12345-0@lo:400:kworker.0 Request processed in 70us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851070.995738:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788851070.995757:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788851070.995765:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019673856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851070.995820:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875746019674112:12345-0@lo:400:kworker.0 Request processed in 98us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851070.995833:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788851070.995850:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788851070.995857:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875746019674368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851070.995892:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875746019674368:12345-0@lo:400:kworker.0 Request processed in 36us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851070.995898:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788851070.995917:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019673728 00000100:00100000:1.0:1788851070.995921:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019673728 00000100:00100000:1.0:1788851070.995945:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788851070.995952:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019673728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851070.995976:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019673856:12345-0@lo:400:kworker.0 Request processed in 210us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851070.995984:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788851070.996000:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019673728:12345-0@lo:400:kworker.0 Request processed in 47us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851070.996003:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788851070.996013:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788851070.996017:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019673984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851070.996054:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019673984:12345-0@lo:400:kworker.0 Request processed in 42us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851070.996061:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788851070.996089:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baeff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019673728:0@lo:400:kworker.0 00000100:00080000:3.0:1788851070.996116:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851070.996124:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baeff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019673984:0@lo:400:kworker.0 00000100:00100000:1.0:1788851070.996136:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baeff3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019673856:0@lo:400:kworker.0 00000100:00100000:1.0:1788851070.996145:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019674368:0@lo:400:kworker.0 00000100:00100000:1.0:1788851070.996172:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1875746019674240:0@lo:400:kworker.0 00000100:00100000:1.0:1788851070.996181:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baeff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019674112:0@lo:400:kworker.0 00000100:00100000:1.0:1788851070.996469:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019674496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851070.996503:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851070.996540:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019674496 00000100:00100000:1.0:1788851070.996550:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019674496 00000100:00100000:1.0:1788851070.996581:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788851070.996589:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875746019674496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788851070.996605:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788851070.996647:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875746019674496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851070.996653:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788851070.996688:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019674496:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788851071.159636:0:12072:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851071.159647:0:12072:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851071.159685:0:12072:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788851071.159691:0:12072:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788851071.365739:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851071.366166:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000777088 00000100:00100000:2.0:1788851071.366176:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000777088 00000100:00100000:2.0:1788851071.366254:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 84 00000100:00100000:2.0:1788851071.366265:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:10507:x1875746000777088:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1788851071.366297:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851071.366322:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879577153 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeba9 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.366445:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a87957715a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.366463:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a87957715a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.366478:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a87957715a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851071.366489:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000100:00080000:1.0:1788851071.366512:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788851071.366632:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879577153 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeba9 expref: 20 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.366660:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a87957715a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeba9 expref: 19 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.366669:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:2.0:1788851071.366672:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788851071.366677:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546c00, rc 0) 00000100:00100000:2.0:1788851071.366746:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:10507:x1875746000777088:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 483us (1016us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788851071.366753:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 84 00000100:00100000:3.0:1788851071.374628:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851071.374806:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000777216 00000100:00100000:0.0:1788851071.374817:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000777216 00000100:00100000:0.0:1788851071.378027:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 85 00000100:00100000:0.0:1788851071.378041:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:10507:x1875746000777216:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:0.0:1788851071.378133:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577168 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.378153:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.378166:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.378182:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957716f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.378189:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957716f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.378195:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957716f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.378474:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577176 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.380704:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.380721:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851071.380799:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.380815:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381030:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577168 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381038:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381045:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851071.381049:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381057:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577168 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381070:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:0.0:1788851071.381073:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851071.381078:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577168 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381105:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577168 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381124:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957716f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381130:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957716f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381136:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957716f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381141:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851071.381155:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957716f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381162:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957716f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381170:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9ba0794900) 00010000:00010000:0.0:1788851071.381173:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851071.381183:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957716f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381189:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957716f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381209:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577176 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381215:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577176 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381227:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577176 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381232:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851071.381236:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577176 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381242:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577176 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381251:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9ba0794b00) 00010000:00010000:0.0:1788851071.381253:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851071.381256:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577176 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.381261:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577176 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851071.381409:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:10507:x1875746000777216:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 3366us (6787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851071.381419:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 85 00000100:00100000:1.0:1788851071.465702:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851071.465824:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000777472 00000100:00100000:3.0:1788851071.465835:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000777472 00000100:00100000:2.0:1788851071.467100:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 86 00000100:00100000:2.0:1788851071.467119:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:10510:x1875746000777472:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1788851071.467146:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851071.467171:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957717d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfebb0 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.467253:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879577184 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.467271:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879577184 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.467284:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879577184 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.467300:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957718b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.467342:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957718b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.467354:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957718b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468269:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577192 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468284:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468294:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851071.468305:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788851071.468432:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879577184 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468440:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879577184 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468447:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879577184 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468464:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851071.468469:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879577184 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468478:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879577184 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468504:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:2.0:1788851071.468507:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851071.468512:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879577184 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468519:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879577184 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468531:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957718b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468537:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957718b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468543:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957718b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468548:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851071.468551:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957718b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468558:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957718b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468568:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9bbcd02500) 00010000:00010000:2.0:1788851071.468571:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851071.468574:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957718b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468580:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957718b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468653:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957717d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb0 expref: 22 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468668:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb0 expref: 21 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.468675:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02400) 00010000:00010000:2.0:1788851071.468677:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851071.468680:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547400, rc 0) 00000100:00100000:2.0:1788851071.468766:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:10510:x1875746000777472:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1652us (3073us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788851071.468806:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 86 00000100:00100000:0.0:1788851071.477299:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851071.477441:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000777600 00000100:00100000:1.0:1788851071.477453:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000777600 00000100:00100000:1.0:1788851071.477609:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 87 00000100:00100000:1.0:1788851071.477623:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:10510:x1875746000777600:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:1.0:1788851071.477695:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795771a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.477714:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795771a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.477727:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795771a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.477754:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795771a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.477773:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795771a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.477797:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795771a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.477804:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851071.477816:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795771a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.477826:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795771a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.477840:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02400) 00010000:00010000:1.0:1788851071.477843:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788851071.477848:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795771a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.477854:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795771a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851071.477931:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:10510:x1875746000777600:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 312us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851071.480773:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 87 00000100:00100000:0.0:1788851071.490857:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851071.491017:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000777856 00000100:00100000:3.0:1788851071.491028:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000777856 00000100:00100000:3.0:1788851071.491090:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:3.0:1788851071.491100:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b912ac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:10510:x1875746000777856:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1788851071.491856:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b912ac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:10510:x1875746000777856:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 753us (1006us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788851071.491867:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:2.0:1788851071.506136:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019674624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851071.506226:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851071.506374:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019674624 00000100:00100000:1.0:1788851071.506392:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019674624 00000100:00100000:1.0:1788851071.506462:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788851071.506473:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875746019674624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851071.506514:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788851071.506714:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851071.506849:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875746019674624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 378us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851071.506857:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788851071.506951:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019674624:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788851071.554496:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1788851071.554530:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1788851071.586980:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851071.587127:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000778112 00000100:00100000:2.0:1788851071.587138:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000778112 00000100:00100000:2.0:1788851071.587202:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 88 00000100:00100000:2.0:1788851071.587213:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:10027:x1875746000778112:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:2.0:1788851071.587240:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851071.587263:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795771a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfebb7 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.587394:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.587423:0:8079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577192 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb0 expref: 23 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.587434:0:8079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.587469:0:8079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb0 expref: 23 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.587483:0:8079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577192 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb0 expref: 23 pid: 8079 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851071.587499:0:8079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8079:1875746019674752:192.168.204.6@tcp:104: 00000100:00100000:2.0:1788851071.587736:0:8079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788851071.592088:0:8079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8079:1875746019674752:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851071.592123:0:8079:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851071.592828:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851071.593056:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000778240 00000100:00100000:2.0:1788851071.593064:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000778240 00010000:00010000:2.0:1788851071.593118:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577192 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb0 expref: 24 pid: 8079 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851071.593151:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:2.0:1788851071.593161:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+24:2353:x1875746000778240:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851071.593177:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851071.593200:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577192 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb0 expref: 24 pid: 8079 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.593213:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb0 expref: 24 pid: 8079 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.593236:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577192 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb0 expref: 24 pid: 8079 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.593252:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02400) 00010000:00010000:2.0:1788851071.593257:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.593266:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.593273:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.593304:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851071.593370:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:2353:x1875746000778240:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 210us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851071.593377:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 47 00010000:00010000:1.0:1788851071.593378:0:8079:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.593390:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851071.593412:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788851071.593663:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795771a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb7 expref: 24 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.593774:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb7 expref: 23 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.593915:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02400) 00010000:00010000:1.0:1788851071.593918:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788851071.593921:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546a00, rc 0) 00000100:00100000:1.0:1788851071.593966:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:10027:x1875746000778112:12345-192.168.204.6@tcp:101:bash.0 Request processed in 6754us (6995us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788851071.593974:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 88 00000100:00100000:3.0:1788851071.598222:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851071.598403:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000778496 00000100:00100000:0.0:1788851071.598413:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000778496 00000100:00100000:0.0:1788851071.598489:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 89 00000100:00100000:0.0:1788851071.598501:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:10027:x1875746000778496:12345-192.168.204.6@tcp:36:bash.0 00010000:00010000:0.0:1788851071.599028:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795771bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.599067:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795771bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.599285:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795771bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788851071.599360:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788851071.599387:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000830730c5 reply state 00000000bb7aad18 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795771bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851071.599398:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788851071.599442:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788851071.600048:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+27:10027:x1875746000778496:12345-192.168.204.6@tcp:36:bash.0 Request processed in 1543us (1833us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788851071.600058:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 89 00000020:00080000:0.0:1788851071.600064:0:5863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788851071.603287:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795771bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.603339:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795771bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.603347:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795771bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.603354:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851071.603360:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795771bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.603368:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795771bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.603388:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02400) 00010000:00010000:3.0:1788851071.603391:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851071.603395:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795771bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.603402:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795771bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851071.605420:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851071.605968:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000778624 00000100:00100000:1.0:1788851071.605979:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000778624 00000100:00100000:1.0:1788851071.606094:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 90 00000100:00100000:1.0:1788851071.606107:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:10027:x1875746000778624:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1788851071.606136:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851071.606159:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795771c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfebbe expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.606250:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795771c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebbe expref: 27 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.606269:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795771c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebbe expref: 27 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.606294:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02400) 00010000:00010000:1.0:1788851071.606298:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788851071.606302:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58000, rc 0) 00000100:00100000:1.0:1788851071.606405:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+27:10027:x1875746000778624:12345-192.168.204.6@tcp:101:bash.0 Request processed in 301us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851071.606411:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 90 00000100:00100000:2.0:1788851071.609133:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851071.609253:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000778752 00000100:00100000:1.0:1788851071.609262:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000778752 00000100:00100000:1.0:1788851071.609382:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:1.0:1788851071.609394:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:10027:x1875746000778752:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1788851071.609413:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851071.609439:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a8795771ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfebc5 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851071.609467:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9fb37b, atime: 0x6a9fb379, ctime: 0x6a9fb37b, blocks: 0xb 00010000:00010000:1.0:1788851071.609493:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1788851071.609498:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851071.609506:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a8795771ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebc5 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.609563:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a8795771ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebc5 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.609576:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59e00, rc 0) 00000100:00100000:1.0:1788851071.609656:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:10027:x1875746000778752:12345-192.168.204.6@tcp:101:bash.0 Request processed in 265us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851071.609663:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00080000:2.0:1788851071.610131:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851071.615487:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851071.615723:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000778880 00000100:00100000:1.0:1788851071.615737:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000778880 00002000:00010000:1.0:1788851071.615833:0:6711:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788851071.615838:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bc1d76300 with x1875746000778880 ext(0->18446744073709551615) 00002000:00010000:1.0:1788851071.615851:0:6711:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bc1d76300. 00000100:00100000:1.0:1788851071.615885:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:1.0:1788851071.615896:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2351:x1875746000778880:12345-192.168.204.6@tcp:10:bash.0 00002000:00010000:1.0:1788851071.616218:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788851071.616223:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788851067 -> 1788851071 00002000:00010000:1.0:1788851071.616226:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788851065 -> 1788851065 00002000:00010000:1.0:1788851071.616229:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788851067 -> 1788851071 00002000:00010000:1.0:1788851071.616231:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788851071.616304:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2351:x1875746000778880:12345-192.168.204.6@tcp:10:bash.0 Request processed in 408us (839us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788851071.616311:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 1 00002000:00010000:1.0:1788851071.616315:0:6711:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788851071.616317:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bc1d76300 with x1875746000778880 ext(0->18446744073709551615) 00002000:00010000:1.0:1788851071.616345:0:6711:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bc1d76300. 00000100:00100000:0.0:1788851071.684437:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851071.684673:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000779008 00000100:00100000:1.0:1788851071.684694:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000779008 00000100:00100000:1.0:1788851071.684835:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 91 00000100:00100000:1.0:1788851071.684846:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+27:10524:x1875746000779008:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:1.0:1788851071.684930:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.684951:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.684965:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.684980:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.684987:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.684994:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685285:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795771df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685295:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795771df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685302:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795771df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851071.685369:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795771df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685381:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685388:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685395:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685402:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851071.685407:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685415:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685428:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851071.685430:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851071.685435:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685441:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685454:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685460:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685472:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685476:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851071.685479:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685485:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685492:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9b9199a100) 00010000:00010000:1.0:1788851071.685494:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851071.685497:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685503:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685518:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795771df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685525:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795771df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685531:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795771df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685536:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851071.685539:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795771df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685554:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795771df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685563:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02400) 00010000:00010000:1.0:1788851071.685565:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851071.685568:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795771df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.685573:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795771df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851071.685659:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+27:10524:x1875746000779008:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 813us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851071.685667:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 91 00000100:00100000:2.0:1788851071.728920:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851071.729273:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000779264 00000100:00100000:1.0:1788851071.729285:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000779264 00000100:00100000:1.0:1788851071.729411:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 92 00000100:00100000:1.0:1788851071.729422:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+27:10527:x1875746000779264:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851071.729447:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851071.729469:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795771e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfebcc expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.729532:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.729544:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.729553:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.729578:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.729585:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.729592:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.729956:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a8795771fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.729968:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a8795771fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.729975:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a8795771fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851071.729984:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788851071.730082:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730090:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730097:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730103:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851071.730107:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730126:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730141:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851071.730144:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851071.730149:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730156:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795771ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730170:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730176:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730182:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730187:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851071.730190:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730196:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730204:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9b9199a100) 00010000:00010000:1.0:1788851071.730207:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851071.730209:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730225:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795771f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730267:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795771e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebcc expref: 30 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730283:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a8795771fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebcc expref: 29 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851071.730290:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02400) 00010000:00010000:1.0:1788851071.730292:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788851071.730295:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58a00, rc 0) 00000100:00100000:1.0:1788851071.730404:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+29:10527:x1875746000779264:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 983us (1637us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788851071.730413:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 92 00000100:00100000:3.0:1788851071.740572:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851071.740980:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000779392 00000100:00100000:0.0:1788851071.740991:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000779392 00000100:00100000:0.0:1788851071.741058:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 93 00000100:00100000:0.0:1788851071.741069:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+29:10527:x1875746000779392:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:0.0:1788851071.741149:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.741168:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb7 expref: 29 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.741178:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577209 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.741240:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb7 expref: 29 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851071.741254:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb7 expref: 29 pid: 8079 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851071.741269:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafc91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019674880:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851071.741760:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf44840 going to sleep for 11 seconds 00000100:00100000:3.0:1788851071.744582:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafc91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019674880:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851071.744615:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851071.746614:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851071.746818:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000779648 00000100:00100000:2.0:1788851071.746828:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000779648 00000100:00100000:2.0:1788851071.746887:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:2.0:1788851071.746897:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+30:9275:x1875746000779648:12345-192.168.204.6@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788851071.747450:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+31:9275:x1875746000779648:12345-192.168.204.6@tcp:35:ldlm_bl.0 Request processed in 553us (843us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1788851071.747460:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:0.0:1788851071.750453:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851071.750597:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000779776 00000100:00100000:2.0:1788851071.750607:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000779776 00010000:00010000:2.0:1788851071.750653:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb7 expref: 31 pid: 8079 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851071.750698:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:2.0:1788851071.750709:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+31:2353:x1875746000779776:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851071.750728:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851071.750734:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb7 expref: 31 pid: 8079 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.750747:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb7 expref: 31 pid: 8079 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.750771:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795771ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebb7 expref: 31 pid: 8079 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.750828:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02400) 00010000:00010000:2.0:1788851071.750834:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.750846:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.750854:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577209 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851071.751031:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851071.751094:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+30:2353:x1875746000779776:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 386us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851071.751103:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 48 00010000:00010000:3.0:1788851071.752897:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.752930:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.752968:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.752975:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577209 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.752983:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.752990:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851071.752995:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.753002:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.753022:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02400) 00010000:00010000:3.0:1788851071.753025:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851071.753030:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577209 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.753036:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851071.753232:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+29:10527:x1875746000779392:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 12160us (12667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851071.753242:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 93 00000100:00100000:0.0:1788851071.758568:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851071.758753:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000780032 00000100:00100000:3.0:1788851071.758766:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000780032 00000100:00100000:2.0:1788851071.759097:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:2.0:1788851071.759109:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+29:10527:x1875746000780032:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1788851071.759362:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+30:10527:x1875746000780032:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 255us (3600us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788851071.759370:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 23 00010000:00010000:0.0:1788851071.762073:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851071.910665:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851071.913904:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000780288 00000100:00100000:3.0:1788851071.914125:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000780288 00000100:00100000:3.0:1788851071.914272:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 94 00000100:00100000:3.0:1788851071.914284:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+30:10538:x1875746000780288:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:3.0:1788851071.914331:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851071.914358:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577210 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfebd3 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.914452:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577217 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.914470:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577217 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.914483:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577217 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.914499:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a87957721e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.914506:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a87957721e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.914513:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a87957721e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.914876:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577225 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.914887:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.914922:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851071.914933:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788851071.915035:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577217 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915044:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577217 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915051:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915058:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ee00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851071.915063:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915071:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577217 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915085:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:3.0:1788851071.915089:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851071.915095:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577217 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915102:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577217 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915185:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a87957721e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915192:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a87957721e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915205:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a87957721e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915211:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851071.915214:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a87957721e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915221:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a87957721e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915229:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9b87c2a500) 00010000:00010000:3.0:1788851071.915232:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851071.915235:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a87957721e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915241:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a87957721e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915287:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577210 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebd3 expref: 33 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915303:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577225 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebd3 expref: 32 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851071.915312:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02400) 00010000:00010000:3.0:1788851071.915314:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851071.915317:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f800, rc 0) 00000100:00100000:3.0:1788851071.915399:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+32:10538:x1875746000780288:12345-192.168.204.6@tcp:101:cat.0 Request processed in 1118us (4744us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788851071.915418:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 94 00000100:00100000:0.0:1788851071.942527:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851071.942616:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000780544 00000100:00100000:3.0:1788851071.942627:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000780544 00000100:00100000:3.0:1788851071.942681:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:3.0:1788851071.942691:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+32:10538:x1875746000780544:12345-192.168.204.6@tcp:35:cat.0 00000100:00100000:3.0:1788851071.942969:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+33:10538:x1875746000780544:12345-192.168.204.6@tcp:35:cat.0 Request processed in 278us (452us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788851071.942977:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:0.0:1788851072.011148:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.011285:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000780800 00000100:00100000:1.0:1788851072.011296:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000780800 00000100:00100000:1.0:1788851072.011373:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 95 00000100:00100000:1.0:1788851072.011386:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+33:10539:x1875746000780800:12345-192.168.204.6@tcp:36:rm.0 00010000:00010000:1.0:1788851072.011455:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788851072.011485:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577225 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebd3 expref: 33 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.011512:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a8795771fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebcc expref: 32 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.011541:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795771c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebbe expref: 31 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.011552:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9bbcd02400) 00010000:00010000:1.0:1788851072.011563:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851072.011586:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577233 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.011602:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577233 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.011612:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577233 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.011627:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957723a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.011633:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957723a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.011639:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957723a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.011970:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577241 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.011979:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577241 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.011987:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577241 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851072.012950:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1788851072.012965:0:5861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 404954182622ns, next at 405954178920ns, rc = 0 00010000:00010000:1.0:1788851072.013035:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577248 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013048:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013058:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013066:0:5861:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577248 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013073:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577248 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013212:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577248 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013239:0:5861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851072.013263:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577241 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013270:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577241 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013277:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577241 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013283:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851072.013296:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577241 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013305:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577241 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013329:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199a500) 00010000:00010000:1.0:1788851072.013333:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788851072.013339:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577241 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013346:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577241 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013366:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577233 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013373:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577233 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013379:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577233 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013385:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851072.013388:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577233 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013394:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577233 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013402:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851072.013404:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851072.013414:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577233 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.013420:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577233 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851072.013432:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006adcea87 reply state 000000002e9c2dc4 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957723a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851072.013442:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788851072.013599:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851072.013607:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577248 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.013613:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58e00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851072.013617:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577248 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.013623:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577248 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.013632:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8a9b9199a500) 00010000:00010000:0.0:1788851072.013635:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788851072.013638:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577248 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.013650:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577248 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.013667:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851072.013669:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851072.013671:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851072.013709:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+32:10539:x1875746000780800:12345-192.168.204.6@tcp:36:rm.0 Request processed in 2322us (2567us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788851072.013718:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 95 00010000:00010000:2.0:1788851072.026464:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957723a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.026485:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957723a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.026494:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957723a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.026501:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851072.026506:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957723a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.026515:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957723a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.026534:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9b9199a100) 00010000:00010000:2.0:1788851072.026538:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851072.026562:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957723a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.026569:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957723a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851072.117176:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.118265:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000781056 00000100:00100000:1.0:1788851072.118280:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000781056 00000100:00100000:1.0:1788851072.118413:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 96 00000100:00100000:1.0:1788851072.118425:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+31:10545:x1875746000781056:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1788851072.118477:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851072.118500:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a87957724f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfebda expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.118630:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577256 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.118647:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577256 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.118662:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577256 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.118680:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a87957725d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.118707:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a87957725d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.118714:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a87957725d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788851072.119394:0:8079:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788851072.119568:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577264 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.119580:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.119589:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.119625:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577256 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.119632:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577256 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.119639:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577256 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.119645:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851072.119648:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577256 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.119656:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577256 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.119682:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851072.119685:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851072.119690:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577256 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.119697:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577256 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851072.119712:0:8079:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003b0d39f7 reply state 000000009882a0f5 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a87957725d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851072.119721:0:8079:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788851072.119752:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a87957724f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebda expref: 34 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.119768:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebda expref: 33 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.119777:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199a500) 00010000:00010000:1.0:1788851072.119829:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851072.119832:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58a00, rc 0) 00000100:00100000:1.0:1788851072.119910:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:10545:x1875746000781056:12345-192.168.204.6@tcp:101:bash.0 Request processed in 1488us (2745us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788851072.119918:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 96 00000100:00100000:0.0:1788851072.125369:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.125451:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000781184 00000100:00100000:1.0:1788851072.125461:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000781184 00000100:00100000:1.0:1788851072.125541:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:1.0:1788851072.125554:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2354:x1875746000781184:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1788851072.125595:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851072.125618:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577272 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfebe1 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851072.125647:0:8281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788851072.125670:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788851072.125675:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851072.125685:0:8281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577272 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe1 expref: 6 pid: 8281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.125706:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577272 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe1 expref: 6 pid: 8281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.125720:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58200, rc 0) 00000100:00100000:1.0:1788851072.125814:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000781184:12345-192.168.204.6@tcp:101:bash.0 Request processed in 263us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851072.125821:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00080000:2.0:1788851072.125937:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788851072.127174:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a87957725d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.127201:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a87957725d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.127210:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a87957725d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.127217:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851072.127221:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a87957725d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.127231:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a87957725d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.127249:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9b9199a100) 00010000:00010000:3.0:1788851072.127253:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851072.127257:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a87957725d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.127284:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a87957725d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851072.129256:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.129352:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000781312 00000100:00100000:1.0:1788851072.129362:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000781312 00000100:00100000:1.0:1788851072.129420:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:1.0:1788851072.129431:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:10545:x1875746000781312:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1788851072.129472:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851072.129493:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfebe8 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.129534:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577272 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe1 expref: 7 pid: 8281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.129555:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851072.129560:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851072.129566:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.129605:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577272 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe1 expref: 7 pid: 8281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.129619:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577272 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe1 expref: 7 pid: 8281 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851072.129635:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6706:1875746019675008:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851072.129734:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788851072.134338:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.134449:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6706:1875746019675008:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851072.134486:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.134508:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59800, rc 0) 00000100:00100000:2.0:1788851072.134568:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000781440 00000100:00100000:2.0:1788851072.134576:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000781440 00000100:00100000:1.0:1788851072.134578:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:10545:x1875746000781312:12345-192.168.204.6@tcp:101:bash.0 Request processed in 5150us (5330us total) trans 0 rc 0/0 00010000:00010000:2.0:1788851072.134613:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577272 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe1 expref: 8 pid: 8281 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851072.134699:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:2.0:1788851072.134776:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:2.0:1788851072.134819:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b906b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000781440:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851072.134835:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851072.134860:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577272 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe1 expref: 7 pid: 8281 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.134875:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577272 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe1 expref: 7 pid: 8281 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.134901:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577272 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe1 expref: 7 pid: 8281 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.134917:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851072.134922:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851072.134930:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.134964:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.135002:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851072.135019:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a59f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5848:1875746019675136:192.168.204.6@tcp:105: 00000100:00100000:2.0:1788851072.135089:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788851072.139419:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a59f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5848:1875746019675136:192.168.204.6@tcp:105: 00010000:00010000:2.0:1788851072.139560:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851072.139712:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b906b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000781440:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 4894us (5382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851072.139724:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:0.0:1788851072.140650:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851072.140690:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000781696 00000100:00100000:0.0:1788851072.140697:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000781696 00000100:00100000:0.0:1788851072.140743:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:0.0:1788851072.140761:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+33:10545:x1875746000781696:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:0.0:1788851072.141108:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:10545:x1875746000781696:12345-192.168.204.6@tcp:35:bash.0 Request processed in 357us (464us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788851072.141116:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:0.0:1788851072.342900:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851072.343324:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000781824 00000100:00100000:3.0:1788851072.343334:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000781824 00000100:00100000:3.0:1788851072.343396:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 97 00000100:00100000:3.0:1788851072.343406:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:10561:x1875746000781824:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851072.343438:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851072.343461:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577280 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfebef expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.343541:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577287 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.343557:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.343570:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851072.343605:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788851072.343609:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788851072.343626:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.343650:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577280 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebef expref: 36 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.343674:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebef expref: 35 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.343716:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:3.0:1788851072.343720:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851072.343724:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f000, rc 0) 00000100:00100000:3.0:1788851072.344330:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+35:10561:x1875746000781824:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 921us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851072.344340:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 97 00000100:00100000:2.0:1788851072.347686:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851072.347759:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000782080 00000100:00100000:3.0:1788851072.347777:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000782080 00000100:00100000:3.0:1788851072.347857:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 98 00000100:00100000:3.0:1788851072.347867:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+35:10561:x1875746000782080:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851072.347891:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851072.347911:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957728e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfebf6 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.348024:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577295 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.348040:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.348053:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851072.348066:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788851072.348208:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957728e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebf6 expref: 38 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.348246:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577295 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebf6 expref: 37 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.348255:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199a500) 00010000:00010000:3.0:1788851072.348258:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851072.348262:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168e600, rc 0) 00000100:00100000:3.0:1788851072.348334:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+37:10561:x1875746000782080:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 468us (659us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788851072.348340:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 98 00000100:00100000:0.0:1788851072.357269:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851072.357462:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000782336 00000100:00100000:3.0:1788851072.357477:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000782336 00000100:00100000:3.0:1788851072.357565:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 99 00000100:00100000:3.0:1788851072.357578:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+37:10561:x1875746000782336:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851072.357605:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851072.357631:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a8795772a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfebfd expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.357773:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795772aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.357826:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795772aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.357839:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795772aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851072.357854:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788851072.358034:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a8795772a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebfd expref: 40 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.358057:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795772aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebfd expref: 39 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.358066:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199a500) 00010000:00010000:3.0:1788851072.358070:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788851072.358074:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168fa00, rc 0) 00000100:00100000:3.0:1788851072.358153:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+39:10561:x1875746000782336:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 578us (899us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788851072.358161:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 99 00000100:00100000:0.0:1788851072.360197:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.360357:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000782464 00000100:00100000:1.0:1788851072.360367:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000782464 00000100:00100000:1.0:1788851072.360439:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:1.0:1788851072.360465:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+39:2353:x1875746000782464:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851072.360481:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851072.360522:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577295 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebf6 expref: 39 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.360543:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199a500) 00010000:00010000:1.0:1788851072.360548:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851072.360607:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+38:2353:x1875746000782464:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 145us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851072.360615:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:2.0:1788851072.382300:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.382895:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000782592 00000100:00100000:1.0:1788851072.382907:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000782592 00000100:00100000:1.0:1788851072.383034:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:1.0:1788851072.383046:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2352:x1875746000782592:12345-192.168.204.6@tcp:1:lfs.0 00010000:00010000:1.0:1788851072.383098:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053088ab2/0x7ad3e1a8795772b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.383120:0:8281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.383130:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851072.383135:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788851072.383141:0:8281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053088ab2/0x7ad3e1a8795772b8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.383179:0:8281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.383212:0:8281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 6 pid: 6706 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851072.383229:0:8281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8281:1875746019675264:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851072.383349:0:8281:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788851072.392053:0:8281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8281:1875746019675264:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851072.392087:0:8281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000053088ab2/0x7ad3e1a8795772b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851072.397264:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.399333:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000782720 00000100:00100000:1.0:1788851072.399350:0:6713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000782720 00002000:00100000:1.0:1788851072.399777:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8a9b87d74000 x1875746000782720/t0(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:138/0 lens 504/0 e 0 to 0 dl 1788851083 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788851072.399868:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9b87d74000 with x1875746000782720 ext(0->8) 00010000:00010000:1.0:1788851072.399880:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 7 pid: 6706 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.399899:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 7 pid: 6706 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851072.399909:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a9b87d74000 00000100:00100000:1.0:1788851072.400013:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:1.0:1788851072.400024:0:6713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2354:x1875746000782720:12345-192.168.204.6@tcp:4:lfs.0 00000100:00100000:1.0:1788851072.400940:0:6713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:2354:x1875746000782720:12345-192.168.204.6@tcp:4:lfs.0 Request processed in 915us (3686us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788851072.400950:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 1 00002000:00100000:1.0:1788851072.400959:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8a9b87d74000 x1875746000782720/t4294967302(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:138/0 lens 504/448 e 0 to 0 dl 1788851083 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788851072.400968:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9b87d74000 with x1875746000782720 ext(0->8) 00010000:00010000:1.0:1788851072.400975:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 9 pid: 6706 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.400989:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 9 pid: 6706 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851072.400996:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a9b87d74000 00000100:00100000:3.0:1788851072.409955:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851072.410271:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000782848 00000100:00100000:0.0:1788851072.410281:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000782848 00010000:00010000:0.0:1788851072.410337:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 9 pid: 6706 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851072.410488:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:0.0:1788851072.410515:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1df9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:2353:x1875746000782848:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851072.410532:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788851072.410551:0:6721:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788851072.410554:0:6721:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788851071 00002000:00010000:0.0:1788851072.410557:0:6721:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788851072 00002000:00010000:0.0:1788851072.410559:0:6721:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788851071 00010000:00010000:0.0:1788851072.410565:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 9 pid: 6706 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.410590:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 9 pid: 6706 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.410618:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096eb8655/0x7ad3e1a879577279 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebe8 expref: 9 pid: 6706 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.410636:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851072.410640:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851072.410646:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000053088ab2/0x7ad3e1a8795772b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.410656:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053088ab2/0x7ad3e1a8795772b8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.410690:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851072.410753:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1df9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2353:x1875746000782848:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 240us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851072.410760:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 50 00010000:00010000:1.0:1788851072.411090:0:8281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000053088ab2/0x7ad3e1a8795772b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.411101:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053088ab2/0x7ad3e1a8795772b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.411128:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053088ab2/0x7ad3e1a8795772b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.411136:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053088ab2/0x7ad3e1a8795772b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.411157:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053088ab2/0x7ad3e1a8795772b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.411165:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59600 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851072.411170:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053088ab2/0x7ad3e1a8795772b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.411180:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053088ab2/0x7ad3e1a8795772b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.411193:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053088ab2/0x7ad3e1a8795772b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.411201:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053088ab2/0x7ad3e1a8795772b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851072.411261:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2352:x1875746000782592:12345-192.168.204.6@tcp:1:lfs.0 Request processed in 28217us (28983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851072.411286:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:3.0:1788851072.416675:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.417769:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000783104 00000100:00100000:1.0:1788851072.417798:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000783104 00000100:00100000:1.0:1788851072.417876:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 26 00000100:00100000:1.0:1788851072.417887:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b912aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+38:10561:x1875746000783104:12345-192.168.204.6@tcp:35:lfs.0 00000004:00010000:1.0:1788851072.417959:0:5864:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795772aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebfd expref: 38 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788851072.418231:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1788851072.418276:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1788851072.418730:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1788851072.418813:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.418831:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577264 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebda expref: 42 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.418841:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772bf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.418877:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebda expref: 42 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.418893:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577264 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebda expref: 42 pid: 8079 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851072.418909:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1875746019675392:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851072.419001:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788851072.425905:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.426424:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1875746019675392:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851072.426462:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851072.426568:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000783232 00000100:00100000:0.0:1788851072.426578:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000783232 00010000:00010000:0.0:1788851072.426630:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577264 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebda expref: 43 pid: 8079 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851072.426684:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:0.0:1788851072.426694:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+43:2354:x1875746000783232:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851072.426713:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851072.426721:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577264 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebda expref: 43 pid: 8079 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.426734:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebda expref: 43 pid: 8079 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.426771:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577264 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebda expref: 43 pid: 8079 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.426825:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199a500) 00010000:00010000:0.0:1788851072.426831:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.426840:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.426848:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772bf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.426869:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851072.426938:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+42:2354:x1875746000783232:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 245us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851072.426963:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 51 00010000:00010000:1.0:1788851072.427453:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.427464:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788851072.427644:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788851072.427919:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788851072.428368:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875746019675520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788851072.428846:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851072.428911:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788851072.429018:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019675520 00000100:00100000:2.0:1788851072.429029:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019675520 00000100:00100000:2.0:1788851072.429081:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788851072.429092:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1875746019675520:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788851072.429209:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1875746019675520:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 118us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851072.429217:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788851072.429359:0:5864:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788851072.429366:0:5864:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1788851072.429389:0:5864:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a9bc1a5ad80, transno 4294967301 00000100:00100000:1.0:1788851072.429416:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875746019675520:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788851072.430847:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788851072.432126:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875746019675648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788851072.434285:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851072.434352:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc1a42000 going to sleep for 11 seconds 00000100:00100000:2.0:1788851072.436118:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019675648 00000100:00100000:2.0:1788851072.436153:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019675648 00000100:00100000:2.0:1788851072.436235:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788851072.436246:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1875746019675648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788851072.436533:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5864:x1875746019675648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 289us (2254us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788851072.436541:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788851072.437164:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875746019675648:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788851072.437256:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788851072.437325:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.437338:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.437347:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.437354:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851072.437359:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.437382:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772bf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.437401:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199a500) 00010000:00010000:1.0:1788851072.437404:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788851072.437410:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.437417:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788851072.437631:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788851072.437731:0:5864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788851072.437744:0:5864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 405378961599ns, next at 406378958687ns, rc = 0 00000001:00080000:1.0:1788851072.437751:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788851072.437808:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199a500) 00010000:00010000:1.0:1788851072.437812:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788851072.437819:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795772aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebfd expref: 46 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851072.437937:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b912aec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+45:10561:x1875746000783104:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 20052us (21277us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788851072.437947:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 26 00000020:00080000:1.0:1788851072.437952:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788851072.441200:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.445113:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000783360 00000100:00100000:1.0:1788851072.445131:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000783360 00000100:00100000:1.0:1788851072.445222:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 100 00000100:00100000:1.0:1788851072.445234:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+45:10561:x1875746000783360:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851072.445281:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851072.445319:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795772c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec04 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.445390:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795772c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec04 expref: 46 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.445409:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795772c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec04 expref: 46 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.445430:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851072.445433:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788851072.445439:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59600, rc 0) 00000100:00100000:1.0:1788851072.445505:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1df8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+46:10561:x1875746000783360:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 273us (4319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851072.445512:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 100 00000100:00100000:3.0:1788851072.450298:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851072.450451:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000783616 00000100:00100000:2.0:1788851072.450464:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000783616 00000100:00100000:2.0:1788851072.450527:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:2.0:1788851072.450539:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+46:10561:x1875746000783616:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1788851072.450819:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+47:10561:x1875746000783616:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 282us (532us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788851072.450827:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:0.0:1788851072.560693:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.560807:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000783744 00000100:00100000:1.0:1788851072.560818:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000783744 00000100:00100000:1.0:1788851072.560889:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 101 00000100:00100000:1.0:1788851072.560901:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+47:10571:x1875746000783744:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:1.0:1788851072.560984:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561004:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561019:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561057:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795772d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561066:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795772d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561079:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795772d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561182:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795772db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561191:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795772db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561198:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795772db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851072.561244:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795772db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561257:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561263:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561271:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561277:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851072.561281:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561298:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561326:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851072.561330:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851072.561336:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561343:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795772cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561358:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795772d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561365:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795772d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561371:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795772d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561377:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851072.561379:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795772d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561386:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795772d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561394:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9b9199a500) 00010000:00010000:1.0:1788851072.561397:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851072.561400:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795772d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561421:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795772d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561438:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795772db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561445:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795772db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561451:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795772db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561456:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851072.561460:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795772db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561467:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795772db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561475:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851072.561478:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851072.561481:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795772db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.561487:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795772db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851072.561750:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+47:10571:x1875746000783744:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 850us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851072.561760:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 101 00000100:00100000:3.0:1788851072.620490:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.620685:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000784000 00000100:00100000:1.0:1788851072.620696:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000784000 00000100:00100000:1.0:1788851072.620830:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 102 00000100:00100000:1.0:1788851072.620840:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+47:10574:x1875746000784000:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851072.620865:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851072.620897:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795772e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec0b expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621048:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795772e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621066:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795772e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621092:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795772e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621109:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795772f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621115:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795772f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621121:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795772f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621258:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795772f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621267:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795772f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621274:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795772f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851072.621285:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788851072.621420:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795772e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621443:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795772e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621450:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795772e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621455:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851072.621460:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795772e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621467:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795772e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621479:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:0.0:1788851072.621483:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851072.621489:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795772e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621495:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795772e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621509:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795772f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621514:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795772f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621520:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795772f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621524:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851072.621533:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795772f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621540:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795772f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621549:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9ba0794900) 00010000:00010000:0.0:1788851072.621551:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851072.621554:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795772f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621560:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795772f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621602:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795772e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec0b expref: 50 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621618:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795772f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec0b expref: 49 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.621625:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:0.0:1788851072.621627:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851072.621629:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6a00, rc 0) 00000100:00100000:0.0:1788851072.621708:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1df9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+49:10574:x1875746000784000:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 869us (1228us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788851072.621716:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 102 00000100:00100000:2.0:1788851072.626362:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851072.629651:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000784128 00000100:00100000:3.0:1788851072.629669:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000784128 00000100:00100000:3.0:1788851072.629762:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 103 00000100:00100000:3.0:1788851072.629774:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+49:10574:x1875746000784128:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:3.0:1788851072.629878:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577305 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.629898:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.629911:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.629956:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.629964:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577305 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.629971:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577305 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.629978:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ee00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851072.629982:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577305 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.629990:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577305 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.630003:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851072.630007:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851072.630012:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577305 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.630019:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577305 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851072.630113:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+49:10574:x1875746000784128:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 341us (3763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851072.630121:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 103 00000100:00100000:1.0:1788851072.637705:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851072.637822:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000784384 00000100:00100000:2.0:1788851072.637833:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000784384 00000100:00100000:2.0:1788851072.637896:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:2.0:1788851072.637909:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+49:10574:x1875746000784384:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1788851072.638170:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+50:10574:x1875746000784384:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 263us (478us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788851072.638178:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:2.0:1788851072.727453:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851072.727578:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000784640 00000100:00100000:3.0:1788851072.727588:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000784640 00000100:00100000:3.0:1788851072.727651:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 104 00000100:00100000:3.0:1788851072.727676:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+50:10584:x1875746000784640:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1788851072.728089:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851072.728093:0:8079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788851072.728203:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577287 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebef expref: 50 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.728226:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:3.0:1788851072.728232:0:8079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851072.728249:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957730c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec12 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.728368:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.728384:0:8079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795772f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec0b expref: 50 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.728393:0:8079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.728428:0:8079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795772f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec0b expref: 50 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.728455:0:8079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795772f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec0b expref: 50 pid: 5862 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851072.728470:0:8079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1dfb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8079:1875746019675776:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851072.729173:0:8079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc29e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851072.735718:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.735931:0:8079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1dfb800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8079:1875746019675776:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851072.735960:0:8079:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851072.736292:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000784768 00000100:00100000:0.0:1788851072.736301:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000784768 00010000:00010000:0.0:1788851072.736353:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795772f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec0b expref: 51 pid: 5862 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851072.736419:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:0.0:1788851072.736429:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:2353:x1875746000784768:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851072.736447:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851072.736454:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795772f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec0b expref: 51 pid: 5862 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.736467:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795772f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec0b expref: 51 pid: 5862 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.736492:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795772f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec0b expref: 51 pid: 5862 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.736511:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:0.0:1788851072.736516:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.736528:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.736536:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.736567:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851072.736594:0:8079:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.736603:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851072.736622:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+50:2353:x1875746000784768:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 195us (915us total) trans 0 rc 0/0 00000004:00200000:1.0:1788851072.736623:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:0.0:1788851072.736630:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 52 00010000:00010000:1.0:1788851072.737058:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957730c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec12 expref: 51 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.737078:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec12 expref: 50 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.737086:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851072.737089:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788851072.737092:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f800, rc 0) 00000100:00100000:1.0:1788851072.741045:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+50:10584:x1875746000784640:12345-192.168.204.6@tcp:101:bash.0 Request processed in 13359us (13590us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788851072.741058:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 104 00000100:00100000:3.0:1788851072.745545:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.747132:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000785024 00000100:00100000:1.0:1788851072.747147:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000785024 00000100:00100000:1.0:1788851072.747219:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 105 00000100:00100000:1.0:1788851072.747229:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1df8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+50:10584:x1875746000785024:12345-192.168.204.6@tcp:36:bash.0 00010000:00010000:1.0:1788851072.747684:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577321 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.747720:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.747735:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788851072.748658:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788851072.748699:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f3112c49 reply state 00000000b2a93d42 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851072.748711:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788851072.749103:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1df8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+53:10584:x1875746000785024:12345-192.168.204.6@tcp:36:bash.0 Request processed in 1870us (3564us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788851072.749113:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 105 00000020:00080000:1.0:1788851072.749119:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788851072.757705:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00010000:00010000:2.0:1788851072.757857:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.757872:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577321 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.757899:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577321 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.757907:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851072.757911:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577321 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.757920:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577321 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.757937:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:2.0:1788851072.757940:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851072.757946:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577321 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.757952:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577321 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851072.758102:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000785152 00000100:00100000:3.0:1788851072.758112:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000785152 00000100:00100000:3.0:1788851072.758264:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 106 00000100:00100000:3.0:1788851072.758275:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:10584:x1875746000785152:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1788851072.758312:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851072.758332:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577328 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec19 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.758410:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.758425:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec12 expref: 53 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.758434:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.758477:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec12 expref: 53 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.758490:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec12 expref: 53 pid: 8079 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851072.758506:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1df9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019675904:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851072.758594:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc29600 going to sleep for 11 seconds 00000100:00100000:2.0:1788851072.767390:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851072.767494:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000785280 00000100:00100000:0.0:1788851072.767506:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000785280 00010000:00010000:0.0:1788851072.767557:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec12 expref: 54 pid: 8079 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851072.767607:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:0.0:1788851072.767617:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:2353:x1875746000785280:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851072.767637:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851072.767645:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec12 expref: 54 pid: 8079 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.767659:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec12 expref: 54 pid: 8079 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.767686:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:0.0:1788851072.767693:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.767705:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.767714:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.767738:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851072.767838:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:2353:x1875746000785280:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 221us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851072.767846:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 53 00010000:00010000:3.0:1788851072.768505:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577313 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec12 expref: 53 pid: 8079 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851072.768549:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1df9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019675904:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851072.768574:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.768583:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.768588:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851072.768642:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788851072.768647:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788851072.768670:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.768703:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577328 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec19 expref: 53 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.768719:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec19 expref: 52 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.768726:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851072.768729:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851072.768732:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168ee00, rc 0) 00000100:00100000:3.0:1788851072.768836:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:10584:x1875746000785152:12345-192.168.204.6@tcp:101:bash.0 Request processed in 10562us (11144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851072.768843:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 106 00000100:00100000:2.0:1788851072.774259:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851072.774368:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000785536 00000100:00100000:0.0:1788851072.774395:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000785536 00000100:00100000:0.0:1788851072.774471:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00100000:0.0:1788851072.774482:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:10584:x1875746000785536:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:0.0:1788851072.775136:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+53:10584:x1875746000785536:12345-192.168.204.6@tcp:35:bash.0 Request processed in 653us (885us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788851072.775146:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 29 00010000:00010000:3.0:1788851072.786245:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851072.873988:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851072.874155:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000785664 00000100:00100000:3.0:1788851072.874167:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000785664 00000100:00100000:3.0:1788851072.874228:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 107 00000100:00100000:3.0:1788851072.874237:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+53:10590:x1875746000785664:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851072.874264:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851072.874295:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577336 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec20 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.874382:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957733d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.874398:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957733d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.874411:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957733d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851072.877918:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788851072.877930:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788851072.877967:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957733d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.878010:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577336 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec20 expref: 55 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.878036:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957733d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec20 expref: 54 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.878065:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:2.0:1788851072.878068:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851072.878072:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f800, rc 0) 00000100:00100000:2.0:1788851072.878159:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:10590:x1875746000785664:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 3920us (4180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851072.878169:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 107 00000100:00100000:2.0:1788851072.884010:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.885647:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000785792 00000100:00100000:1.0:1788851072.885661:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000785792 00000100:00100000:1.0:1788851072.885744:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 108 00000100:00100000:1.0:1788851072.885764:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:10590:x1875746000785792:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851072.885850:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851072.885875:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577344 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec27 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.885952:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957734b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.885970:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957734b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.885983:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957734b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886001:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577352 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886008:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886016:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886128:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879577359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886139:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879577359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886148:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879577359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851072.886189:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788851072.886199:0:8079:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788851072.886222:0:8079:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879577359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886235:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879577359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886244:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957734b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886251:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957734b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886258:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957734b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886265:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851072.886269:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957734b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886277:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957734b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886289:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851072.886292:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851072.886297:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957734b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886317:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957734b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886341:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886357:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577352 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886363:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886368:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851072.886371:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886378:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577352 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886386:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9b9199a500) 00010000:00010000:1.0:1788851072.886388:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851072.886391:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577352 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886397:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a879577352 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.886432:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577344 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec27 expref: 56 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.887508:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879577359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec27 expref: 55 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.887518:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851072.887521:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851072.887535:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59800, rc 0) 00000100:00100000:1.0:1788851072.887619:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:10590:x1875746000785792:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1865us (3620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851072.887628:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 108 00000100:00100000:3.0:1788851072.899284:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851072.899408:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000786176 00000100:00100000:0.0:1788851072.899419:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000786176 00000100:00100000:0.0:1788851072.899497:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:0.0:1788851072.899508:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1df9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:2354:x1875746000786176:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851072.899526:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851072.899554:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a879577359 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec27 expref: 55 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.899577:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:0.0:1788851072.899583:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851072.899653:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1df9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:2354:x1875746000786176:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 146us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851072.899660:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:3.0:1788851072.913893:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851072.913993:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000786048 00000100:00100000:2.0:1788851072.914004:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000786048 00000100:00100000:2.0:1788851072.914073:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 109 00000100:00100000:2.0:1788851072.914084:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:10590:x1875746000786048:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1788851072.914111:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851072.914135:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577360 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec2e expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.914252:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.914270:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec19 expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.914281:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.914334:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec19 expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.914373:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec19 expref: 55 pid: 5862 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851072.914389:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019676032:192.168.204.6@tcp:104: 00000100:00100000:2.0:1788851072.914501:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851072.916487:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019676032:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851072.916517:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851072.926401:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851072.927596:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000786304 00000100:00100000:0.0:1788851072.927611:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000786304 00010000:00010000:1.0:1788851072.928258:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec19 expref: 56 pid: 5862 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851072.928320:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:1.0:1788851072.928331:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b906b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:2354:x1875746000786304:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851072.928349:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851072.928358:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec19 expref: 56 pid: 5862 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.928373:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec19 expref: 56 pid: 5862 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.928400:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a87957732f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec19 expref: 56 pid: 5862 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.928419:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851072.928424:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.928435:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.928454:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.928538:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851072.928618:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b906b6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:2354:x1875746000786304:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 289us (2228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851072.928625:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 54 00010000:00010000:2.0:1788851072.928812:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.928822:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851072.928844:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788851072.929042:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577360 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec2e expref: 56 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.929061:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec2e expref: 55 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851072.929068:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:2.0:1788851072.929071:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788851072.929074:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546000, rc 0) 00000100:00100000:2.0:1788851072.929102:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1df9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:10590:x1875746000786048:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 15021us (15223us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788851072.929127:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 109 00000100:00100000:1.0:1788851072.936473:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851072.937224:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000786560 00000100:00100000:0.0:1788851072.937236:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000786560 00000100:00100000:0.0:1788851072.937324:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:0.0:1788851072.937336:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:10590:x1875746000786560:12345-192.168.204.6@tcp:103:lfs.0 00010000:00010000:0.0:1788851072.937354:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851072.937382:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795772c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec04 expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851072.937421:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:0.0:1788851072.937428:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851072.937494:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:10590:x1875746000786560:12345-192.168.204.6@tcp:103:lfs.0 Request processed in 160us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851072.937502:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:2.0:1788851072.944416:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851072.945328:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000786688 00000100:00100000:3.0:1788851072.945341:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000786688 00000100:00100000:3.0:1788851072.945424:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 110 00000100:00100000:3.0:1788851072.945435:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:10590:x1875746000786688:12345-192.168.204.6@tcp:58:lfs.0 00010000:00010000:3.0:1788851072.945568:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577375 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.945588:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577375 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851072.945612:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577375 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851072.945854:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788851072.946109:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:10590:x1875746000786688:12345-192.168.204.6@tcp:58:lfs.0 Request processed in 675us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851072.946182:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 110 00000100:00100000:3.0:1788851072.956690:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851072.962139:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000786816 00000100:00100000:1.0:1788851072.962160:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000786816 00000100:00100000:1.0:1788851072.962346:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 111 00000100:00100000:1.0:1788851072.962361:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:10590:x1875746000786816:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851072.962387:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851072.962414:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a87957737c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec35 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.962489:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577375 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.962502:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a87957737c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec35 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.962526:0:5861:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577375 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.962543:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a87957737c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec35 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.962559:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851072.962562:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788851072.962584:0:5861:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a87957737c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec35 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851072.962593:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58a00, rc 0) 00000100:00100000:1.0:1788851072.962674:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1df8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:10590:x1875746000786816:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 316us (5993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851072.962681:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 111 00000100:00100000:2.0:1788851073.025047:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851073.025095:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851073.025133:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851073.025167:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851073.025186:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851073.025256:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000787072 00000100:00100000:3.0:1788851073.025267:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000787072 00000100:00100000:0.0:1788851073.025325:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000786944 00000100:00100000:0.0:1788851073.025331:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000786944 00000100:00100000:3.0:1788851073.025342:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000787456 00000100:00100000:3.0:1788851073.025347:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000787456 00000100:00100000:0.0:1788851073.025377:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 292 00000100:00100000:3.0:1788851073.025380:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 145 00000100:00100000:3.0:1788851073.025396:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:2353:x1875746000787072:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851073.025396:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000786944:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851073.025478:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000786944:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 90us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851073.025485:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 292 00000100:00080000:2.0:1788851073.025859:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851073.025877:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 146 00000100:00100000:2.0:1788851073.025887:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000787456:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851073.025965:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000787328 00000100:00100000:1.0:1788851073.025970:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000787328 00000100:00100000:3.0:1788851073.026007:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:2353:x1875746000787072:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 616us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851073.026016:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 145 00000100:00100000:1.0:1788851073.026016:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000787200 00000100:00100000:1.0:1788851073.026022:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000787200 00000100:00100000:1.0:1788851073.026051:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:1.0:1788851073.026060:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2353:x1875746000787328:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851073.026092:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2353:x1875746000787328:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 33us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851073.026099:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:1.0:1788851073.026111:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00100000:1.0:1788851073.026118:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9ba058dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000787200:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851073.026142:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9ba058dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000787200:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 24us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851073.026148:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00080000:1.0:1788851073.026320:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851073.034760:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000787456:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 8860us (9556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851073.034777:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 146 00000040:00080000:2.0:1788851073.746107:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788851073.746117:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788851073.746202:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788851073.746209:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788851073.746556:0:11702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafccbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875746019676160:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788851073.746864:0:11702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9840 going to sleep for 11 seconds 00000100:00100000:2.0:1788851073.755339:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851073.755685:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000787584 00000100:00100000:0.0:1788851073.755694:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000787584 00000100:00100000:0.0:1788851073.755815:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 112 00000100:00100000:0.0:1788851073.755828:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:10591:x1875746000787584:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788851073.755896:0:5862:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788851073.756011:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:10591:x1875746000787584:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 186us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851073.756018:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 112 00000100:00100000:3.0:1788851073.760463:0:11702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafccbb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875746019676160:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788851073.775071:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851073.775161:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000787712 00000100:00100000:1.0:1788851073.775177:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000787712 00000100:00100000:1.0:1788851073.775252:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 113 00000100:00100000:1.0:1788851073.775265:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:10591:x1875746000787712:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788851073.775387:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879577383 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.775420:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879577383 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.775437:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879577383 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.775615:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a87957738a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.775625:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a87957738a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.775633:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a87957738a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.775658:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577391 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.775666:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.775673:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851073.775714:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788851073.775718:0:8079:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788851073.775735:0:8079:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.775745:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879577383 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.775758:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879577383 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.775766:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879577383 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776552:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851073.776561:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879577383 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776571:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879577383 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776585:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a9bbcd02f00) 00010000:00010000:1.0:1788851073.776588:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851073.776592:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879577383 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776599:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a879577383 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776614:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a87957738a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776619:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a87957738a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776625:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a87957738a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776630:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851073.776642:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a87957738a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776648:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a87957738a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776656:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8a9b9199a500) 00010000:00010000:1.0:1788851073.776658:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851073.776661:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a87957738a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776667:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a87957738a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776683:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776690:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577391 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776695:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577391 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776700:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851073.776703:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577391 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776708:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577391 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776715:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851073.776717:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851073.776727:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577391 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.776733:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577391 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851073.778569:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:10591:x1875746000787712:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 Request processed in 3296us (3502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851073.778584:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 113 00000100:00100000:2.0:1788851073.788641:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851073.788740:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000787968 00000100:00100000:0.0:1788851073.788756:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000787968 00000100:00100000:0.0:1788851073.789122:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 114 00000100:00100000:0.0:1788851073.789136:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:10591:x1875746000787968:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851073.789184:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851073.789211:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577398 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec3c expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.789562:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957739f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.789587:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957739f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.789601:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957739f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851073.789612:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788851073.789802:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957739f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.789811:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957739f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.789831:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957739f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.789838:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851073.789843:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957739f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.790213:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957739f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.790228:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:0.0:1788851073.790245:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788851073.790251:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957739f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.790258:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957739f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.790332:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577398 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec3c expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.790344:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a9bbcd02f00) 00010000:00010000:0.0:1788851073.790346:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788851073.790351:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577398 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec3c expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.790373:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6000, rc 0) 00000100:00100000:0.0:1788851073.790624:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:10591:x1875746000787968:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 1490us (1998us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1788851073.790633:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 114 00000100:00100000:2.0:1788851073.800654:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851073.801958:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000788096 00000100:00100000:0.0:1788851073.801977:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000788096 00000100:00100000:1.0:1788851073.812052:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 115 00010000:00010000:3.0:1788851073.812100:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851073.812307:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:10591:x1875746000788096:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788851073.812353:0:8079:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788851073.812517:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:10591:x1875746000788096:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 238us (11875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851073.812526:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 115 00000100:00100000:3.0:1788851073.820673:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851073.822085:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000788352 00000100:00100000:1.0:1788851073.822101:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000788352 00000100:00100000:1.0:1788851073.822187:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 116 00000100:00100000:1.0:1788851073.822198:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:10591:x1875746000788352:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851073.822226:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851073.822229:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788851073.822260:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957733d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec20 expref: 56 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.822295:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851073.822301:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851073.822318:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec43 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788851073.823377:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788851073.823595:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795773b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.823609:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795773b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.823617:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795773b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.823662:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec43 expref: 58 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.823682:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795773b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec43 expref: 57 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.823691:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a9b9199a500) 00010000:00010000:1.0:1788851073.823694:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851073.823697:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58200, rc 0) 00000100:00100000:1.0:1788851073.823812:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:10591:x1875746000788352:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 1582us (3128us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788851073.823822:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 116 00000100:00100000:3.0:1788851073.829917:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851073.830185:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000788608 00000100:00100000:1.0:1788851073.830201:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000788608 00000100:00100000:1.0:1788851073.830300:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 117 00000100:00100000:1.0:1788851073.830313:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:10591:x1875746000788608:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788851073.830389:0:8079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851073.830441:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795773b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec43 expref: 57 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.830461:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a9b9199a500) 00010000:00010000:1.0:1788851073.830472:0:8079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851073.830494:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.830510:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.830519:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.830572:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x85665965 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.830580:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x85665965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.830587:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x85665965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.830660:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.830668:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.830675:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.830681:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851073.830986:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.830996:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.831006:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851073.831009:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851073.831013:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.831020:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.831032:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x85665965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.831039:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x85665965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.831045:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x85665965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.831050:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851073.831053:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x85665965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.831060:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x85665965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.831067:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x85665965 (ffff8a9b9199a900) 00010000:00010000:1.0:1788851073.831069:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851073.831080:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x85665965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.831087:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x85665965 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851073.831247:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:10591:x1875746000788608:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 936us (1344us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788851073.831258:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 117 00000100:00100000:2.0:1788851073.838110:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851073.838665:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000788736 00000100:00100000:0.0:1788851073.838677:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000788736 00000100:00100000:0.0:1788851073.840054:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 118 00000100:00100000:0.0:1788851073.840069:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:10591:x1875746000788736:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851073.840092:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851073.840119:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795773d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec4a expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.840190:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795773d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.840215:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795773d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.840229:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795773d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.840514:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795773d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec4a expref: 58 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.840533:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795773d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec4a expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.840541:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a9ba0794900) 00010000:00010000:0.0:1788851073.840544:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788851073.840547:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7600, rc 0) 00000100:00100000:0.0:1788851073.840621:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:10591:x1875746000788736:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 555us (2522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851073.840628:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 118 00000100:00100000:2.0:1788851073.845220:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851073.845817:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000788992 00000100:00100000:1.0:1788851073.845828:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000788992 00000100:00100000:1.0:1788851073.845898:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 119 00000100:00100000:1.0:1788851073.845910:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:10591:x1875746000788992:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788851073.846004:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.846025:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.846040:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851073.846326:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:1.0:1788851073.846337:0:5863:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 406787554884ns, next at 407787552234ns, rc = 0 00000004:00010000:1.0:1788851073.846471:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000855a6108 reply state 00000000a9bf1d53 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851073.846480:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788851073.846586:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+59:10591:x1875746000788992:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 678us (1377us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1788851073.846625:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 119 00000100:00100000:0.0:1788851073.849884:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00010000:00010000:3.0:1788851073.849994:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851073.850008:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851073.850033:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851073.850040:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851073.850045:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851073.850053:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851073.850071:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a9ba0794900) 00010000:00010000:3.0:1788851073.850074:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788851073.850079:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851073.850085:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a8795773de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851073.850165:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000789120 00000100:00100000:1.0:1788851073.850175:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000789120 00000100:00100000:1.0:1788851073.850236:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 120 00000100:00100000:1.0:1788851073.850246:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+58:10591:x1875746000789120:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851073.850303:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851073.850322:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec51 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.850394:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec51 expref: 59 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.850409:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec51 expref: 59 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.850426:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a9ba0794900) 00010000:00010000:1.0:1788851073.850429:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788851073.850431:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58000, rc 0) 00000100:00100000:1.0:1788851073.850495:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+59:10591:x1875746000789120:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 250us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851073.850502:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 120 00000100:00100000:0.0:1788851073.858776:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851073.858909:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000789248 00000100:00100000:1.0:1788851073.858920:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000789248 00000100:00100000:1.0:1788851073.859055:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 37 00000100:00100000:1.0:1788851073.859066:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2353:x1875746000789248:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788851073.859424:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:2353:x1875746000789248:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 360us (657us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788851073.859448:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 37 00000100:00100000:2.0:1788851073.863128:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851073.863520:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000789504 00000100:00100000:1.0:1788851073.863529:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000789504 00000100:00100000:1.0:1788851073.863624:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 30 00000100:00100000:1.0:1788851073.863634:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+59:10591:x1875746000789504:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788851073.863900:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+60:10591:x1875746000789504:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 267us (782us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788851073.863906:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 30 00000100:00100000:0.0:1788851073.874602:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851073.874664:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000789760 00000100:00100000:1.0:1788851073.874674:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000789760 00000100:00100000:1.0:1788851073.874775:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 121 00000100:00100000:1.0:1788851073.874796:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+60:10591:x1875746000789760:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788851073.874911:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+60:10591:x1875746000789760:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 129us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851073.874918:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 121 00000100:00100000:2.0:1788851073.878185:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851073.878454:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000789888 00000100:00100000:1.0:1788851073.878465:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000789888 00000100:00100000:1.0:1788851073.878531:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 122 00000100:00100000:1.0:1788851073.878541:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+60:10591:x1875746000789888:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851073.878565:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851073.878589:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795773ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec58 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.878664:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795773f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.878691:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795773f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.878705:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795773f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851073.878928:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788851073.878950:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795773f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.878978:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795773ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec58 expref: 62 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.878998:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795773f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec58 expref: 61 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.879008:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a9ba0794900) 00010000:00010000:1.0:1788851073.879011:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788851073.879015:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58800, rc 0) 00000100:00100000:1.0:1788851073.879237:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+61:10591:x1875746000789888:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 696us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851073.879245:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 122 00000100:00100000:3.0:1788851073.883277:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851073.883914:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000790016 00000100:00100000:1.0:1788851073.883925:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000790016 00000100:00100000:1.0:1788851073.883979:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:1.0:1788851073.883989:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:2353:x1875746000790016:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851073.884012:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851073.884035:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b7e2158/0x7ad3e1a8795773fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec5f expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851073.884093:0:8281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fb381, blocks: 0x1 00010000:00010000:1.0:1788851073.884123:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=406s v=(0 0) 00010000:00010000:1.0:1788851073.884128:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851073.884138:0:8281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b7e2158/0x7ad3e1a8795773fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec5f expref: 10 pid: 8281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.884158:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b7e2158/0x7ad3e1a8795773fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec5f expref: 10 pid: 8281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.884173:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58e00, rc 0) 00000100:00100000:1.0:1788851073.884239:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1df8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+10:2353:x1875746000790016:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 251us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851073.884246:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:2.0:1788851073.888485:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851073.888645:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000790272 00000100:00100000:1.0:1788851073.888656:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000790272 00000100:00100000:1.0:1788851073.888755:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 123 00000100:00100000:1.0:1788851073.888766:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+61:10591:x1875746000790272:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788851073.888910:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+61:10591:x1875746000790272:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 145us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851073.888923:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 123 00000100:00100000:2.0:1788851073.891055:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851073.891210:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000790400 00000100:00100000:1.0:1788851073.891219:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000790400 00000100:00100000:1.0:1788851073.891319:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:1.0:1788851073.891329:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+10:10591:x1875746000790400:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851073.891367:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851073.891388:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0484133/0x7ad3e1a879577401 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec66 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.891434:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b7e2158/0x7ad3e1a8795773fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec5f expref: 11 pid: 8281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.891445:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851073.891450:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851073.891455:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0484133/0x7ad3e1a879577401 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec66 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.891492:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b7e2158/0x7ad3e1a8795773fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec5f expref: 11 pid: 8281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.891508:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b7e2158/0x7ad3e1a8795773fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec5f expref: 11 pid: 8281 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851073.891523:0:6706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6706:1875746019676288:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851073.891628:0:6706:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc1a42b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851073.894852:0:6706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6706:1875746019676288:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851073.894937:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f0484133/0x7ad3e1a879577401 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec66 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.894962:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58200, rc 0) 00000100:00100000:1.0:1788851073.895051:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+11:10591:x1875746000790400:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 3723us (4001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851073.895061:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:2.0:1788851073.895512:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851073.895701:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000790528 00000100:00100000:1.0:1788851073.895707:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000790528 00010000:00010000:1.0:1788851073.895735:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b7e2158/0x7ad3e1a8795773fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec5f expref: 11 pid: 8281 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851073.895842:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:1.0:1788851073.895853:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+11:2354:x1875746000790528:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851073.895869:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851073.895895:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b7e2158/0x7ad3e1a8795773fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec5f expref: 11 pid: 8281 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.895906:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b7e2158/0x7ad3e1a8795773fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec5f expref: 11 pid: 8281 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.895925:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b7e2158/0x7ad3e1a8795773fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec5f expref: 11 pid: 8281 timeout: 506 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.895936:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851073.895939:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851073.895945:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0484133/0x7ad3e1a879577401 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec66 expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.895952:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0484133/0x7ad3e1a879577401 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec66 expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851073.895988:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f0484133/0x7ad3e1a879577401 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec66 expref: 10 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851073.896000:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5847:1875746019676416:192.168.204.6@tcp:105: 00000100:00100000:1.0:1788851073.896056:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc1a42b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851073.898682:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5847:1875746019676416:192.168.204.6@tcp:105: 00010000:00010000:1.0:1788851073.898708:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851073.898762:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafccb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+10:2354:x1875746000790528:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 2911us (3251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851073.898774:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:3.0:1788851073.900258:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851073.900346:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000790656 00000100:00100000:1.0:1788851073.900354:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000790656 00002000:00100000:1.0:1788851073.900402:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8a9bc1dfa300 x1875746000790656/t0(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:139/0 lens 504/0 e 0 to 0 dl 1788851084 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788851073.900413:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bc1dfa300 with x1875746000790656 ext(0->12) 00002000:00010000:1.0:1788851073.900418:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bc1dfa300 00000100:00100000:1.0:1788851073.900477:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:1.0:1788851073.900487:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+10:2353:x1875746000790656:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788851073.901019:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+12:2353:x1875746000790656:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 Request processed in 531us (764us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788851073.901032:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 2 00002000:00100000:1.0:1788851073.901039:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8a9bc1dfa300 x1875746000790656/t4294967308(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:139/0 lens 504/448 e 0 to 0 dl 1788851084 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788851073.901057:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bc1dfa300 with x1875746000790656 ext(0->12) 00002000:00010000:1.0:1788851073.901061:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bc1dfa300 00000100:00100000:2.0:1788851073.903511:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851073.903766:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000790784 00000100:00100000:1.0:1788851073.903776:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000790784 00000100:00100000:1.0:1788851073.904002:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 124 00000100:00100000:1.0:1788851073.904013:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+61:10591:x1875746000790784:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788851073.933638:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+61:10591:x1875746000790784:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 Request processed in 29616us (30125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851073.933658:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 124 00000001:00080000:3.0:1788851073.934907:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000001:00080000:3.0:1788851073.934937:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788851073.934948:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1788851073.934972:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788851073.935000:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a9bc18e0780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788851073.935005:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9b8660ce00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a9bc18e03c0 00000020:00080000:3.0:1788851073.935009:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9b8660c100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a9bc1de4000 00000020:00080000:1.0:1788851073.935055:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788851073.935270:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851073.935301:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019676544:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788851073.935368:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851073.935439:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019676672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788851073.935464:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851073.935498:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019676544 00000100:00100000:0.0:1788851073.935507:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019676544 00000100:00100000:0.0:1788851073.935682:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019676672 00000100:00100000:0.0:1788851073.935686:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019676672 00000100:00100000:0.0:1788851073.935706:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788851073.935715:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3308:x1875746019676544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788851073.935823:0:6707:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1788851073.935852:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577408 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.935873:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a8795771ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebc5 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.935883:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788851073.935887:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851073.935892:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577408 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.935923:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a8795771ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebc5 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.935938:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a8795771ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebc5 expref: 11 pid: 6706 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851073.935951:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6707:1875746019676800:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851073.936024:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf44300 going to sleep for 11 seconds 00000100:00100000:0.0:1788851073.936041:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788851073.936049:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875746019676672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788851073.936217:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788851073.936221:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788851073 00002000:00010000:0.0:1788851073.936224:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788851073.936226:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788851073 -> 1788851073 00002000:00010000:0.0:1788851073.936228:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788851073.936270:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3310:x1875746019676672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 221us (804us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788851073.936277:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1788851073.936332:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a9baef0c000/2, rc 0, transno 4294967309 00000100:00100000:0.0:1788851073.936338:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019676672:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788851073.936746:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851073.937864:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019676928:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788851073.937923:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851073.938293:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019676928 00000100:00100000:2.0:1788851073.938302:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019676928 00000100:00100000:2.0:1788851073.938373:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788851073.938383:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875746019676928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788851073.938409:0:6704:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1788851073.938454:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9fb37f, atime: 0x6a9fb380, ctime: 0x6a9fb37f, blocks: 0x1 00010000:00010000:2.0:1788851073.938463:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff776b8b/0x7ad3e1a87957740f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851073.938477:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=406s v=(0 0) 00010000:00010000:2.0:1788851073.938482:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851073.938488:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff776b8b/0x7ad3e1a87957740f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851073.938505:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff776b8b/0x7ad3e1a87957740f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851073.938516:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff776b8b/0x7ad3e1a87957740f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851073.938524:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff776b8b/0x7ad3e1a87957740f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851073.938539:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1788851073.939015:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788851073.939717:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851073.939728:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff776b8b/0x7ad3e1a87957740f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.939750:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547400 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851073.939755:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff776b8b/0x7ad3e1a87957740f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.939766:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff776b8b/0x7ad3e1a87957740f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.939803:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff776b8b/0x7ad3e1a87957740f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.939825:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff776b8b/0x7ad3e1a87957740f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.939846:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851073.939848:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851073.939850:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851073.939913:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875746019676928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1530us (1987us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788851073.939922:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1788851073.941598:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788851073.941632:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a9bc18e0cc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788851073.941653:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9b8660c500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a9bc18e0300 00000020:00080000:3.0:1788851073.941657:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9b8660c900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a9baeff7400 00000020:00080000:2.0:1788851073.941698:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 0 00000020:00080000:2.0:1788851073.941972:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000020:00080000:3.0:1788851073.942539:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1788851073.942872:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a9bafccaa00/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788851073.942882:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019676928:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788851073.945460:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851073.947379:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851073.947500:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef0ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6707:1875746019676800:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788851073.947531:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577408 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851073.947709:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000791040 00000100:00100000:3.0:1788851073.947717:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000791040 00010000:00010000:3.0:1788851073.947765:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a8795771ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebc5 expref: 12 pid: 6706 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851073.947823:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000790912 00000100:00100000:1.0:1788851073.947829:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000790912 00000100:00100000:3.0:1788851073.947834:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:3.0:1788851073.947847:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:2354:x1875746000791040:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851073.947864:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788851073.947866:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 43 00010000:00010000:3.0:1788851073.947874:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a8795771ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebc5 expref: 13 pid: 6706 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851073.947879:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:2354:x1875746000790912:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788851073.947897:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a8795771ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebc5 expref: 13 pid: 6706 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851073.947922:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a8795771ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfebc5 expref: 13 pid: 6706 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851073.947940:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851073.947945:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851073.947957:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577408 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851073.947966:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577408 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851073.948009:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851073.948062:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+12:2354:x1875746000791040:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 219us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851073.948070:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 56 00010000:00010000:0.0:1788851073.948137:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577408 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.948147:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577408 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.948159:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577408 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.948167:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577408 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851073.948189:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851073.948503:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851073.948511:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577408 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851073.948519:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7e00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851073.948524:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577408 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851073.948534:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577408 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851073.948546:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577408 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851073.948553:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577408 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851073.948585:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851073.948587:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851073.948589:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851073.952859:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3308:x1875746019676544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17137us (17482us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788851073.952887:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:2.0:1788851073.955259:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a9baef0df80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788851073.955276:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019676544:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788851073.995883:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+11:2354:x1875746000790912:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 Request processed in 47996us (50421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851073.995900:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 43 00000001:00080000:0.0:1788851073.995941:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1788851073.995956:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1788851074.002205:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851074.002351:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000791296 00000100:00100000:1.0:1788851074.002362:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000791296 00000100:00100000:1.0:1788851074.002462:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 125 00000100:00100000:1.0:1788851074.002475:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+15:10591:x1875746000791296:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788851074.002573:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851074.002605:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795773f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec58 expref: 15 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.002628:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a9ba0794900) 00010000:00010000:1.0:1788851074.002634:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851074.002666:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577416 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.002682:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577416 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.002692:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577416 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851074.003138:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf22bf68 reply state 000000006d94c4ed transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577416 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851074.003147:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788851074.003253:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+16:10591:x1875746000791296:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 781us (1058us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788851074.003261:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 125 00010000:00010000:2.0:1788851074.006209:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577416 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.006231:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577416 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.006240:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577416 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.006246:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851074.006252:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577416 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.006259:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577416 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.006288:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a9ba0794900) 00010000:00010000:2.0:1788851074.006292:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851074.006298:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577416 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.006323:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577416 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851074.013059:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851074.014149:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000791424 00000100:00100000:0.0:1788851074.014163:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000791424 00000100:00100000:0.0:1788851074.014232:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:0.0:1788851074.014242:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000791424:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788851074.014725:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788851074.014741:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788851073 -> 1788851072 00002000:00010000:0.0:1788851074.014744:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788851072 00002000:00010000:0.0:1788851074.014746:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788851073 -> 1788851072 00002000:00010000:0.0:1788851074.014748:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788851074.015773:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2354:x1875746000791424:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 1525us (2718us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788851074.015814:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:3.0:1788851074.019464:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851074.019823:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000791680 00000100:00100000:0.0:1788851074.019834:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000791680 00000100:00100000:0.0:1788851074.019897:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 126 00000100:00100000:0.0:1788851074.019908:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+15:10591:x1875746000791680:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788851074.019986:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957741d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.020006:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795773d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec4a expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.020017:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957741d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.020097:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795773d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec4a expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.020112:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795773d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec4a expref: 15 pid: 5862 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851074.020128:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef0ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019677056:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851074.020277:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf44840 going to sleep for 11 seconds 00000100:00100000:3.0:1788851074.029612:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef0ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019677056:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851074.029661:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957741d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851074.031288:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851074.031812:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000791808 00000100:00100000:0.0:1788851074.031822:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000791808 00010000:00010000:0.0:1788851074.031863:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795773d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec4a expref: 16 pid: 5862 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851074.031908:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:0.0:1788851074.031918:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1df9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+16:2354:x1875746000791808:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851074.031943:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851074.031953:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795773d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec4a expref: 16 pid: 5862 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.031967:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795773d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec4a expref: 16 pid: 5862 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.031996:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795773d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec4a expref: 16 pid: 5862 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.032014:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a9ba0794900) 00010000:00010000:0.0:1788851074.032034:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957741d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.032046:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957741d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.032055:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957741d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.032088:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851074.032156:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1df9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+15:2354:x1875746000791808:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 239us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851074.032164:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 57 00010000:00010000:3.0:1788851074.032293:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957741d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.032301:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957741d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.032331:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957741d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.032338:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957741d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.032345:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957741d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.032351:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851074.032356:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957741d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.032364:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957741d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.032374:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a9ba0794900) 00010000:00010000:3.0:1788851074.032377:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788851074.032382:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957741d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.032388:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957741d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851074.032440:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1df9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:10591:x1875746000791680:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 Request processed in 12535us (12987us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788851074.032447:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 126 00000100:00100000:0.0:1788851074.037120:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851074.037215:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000791936 00000100:00100000:2.0:1788851074.037226:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000791936 00000100:00100000:2.0:1788851074.037329:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00100000:2.0:1788851074.037340:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000791936:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788851074.037393:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577424 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.037416:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0484133/0x7ad3e1a879577401 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec66 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.037425:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851074.037431:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788851074.037436:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577424 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.037481:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0484133/0x7ad3e1a879577401 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec66 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.037496:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0484133/0x7ad3e1a879577401 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec66 expref: 7 pid: 6706 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851074.037513:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6707:1875746019677184:192.168.204.6@tcp:104: 00000100:00100000:2.0:1788851074.037629:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788851074.039624:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6707:1875746019677184:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788851074.039656:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577424 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851074.041016:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851074.041296:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000792064 00000100:00100000:3.0:1788851074.041306:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000792064 00010000:00010000:3.0:1788851074.041361:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0484133/0x7ad3e1a879577401 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec66 expref: 8 pid: 6706 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851074.041411:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:3.0:1788851074.041421:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2353:x1875746000792064:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851074.041438:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851074.041464:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0484133/0x7ad3e1a879577401 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec66 expref: 8 pid: 6706 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.041479:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0484133/0x7ad3e1a879577401 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec66 expref: 8 pid: 6706 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.041508:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0484133/0x7ad3e1a879577401 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec66 expref: 8 pid: 6706 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.041526:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851074.041531:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851074.041537:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577424 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.041570:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577424 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.041643:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851074.041713:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000792064:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 293us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851074.041725:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 58 00010000:00010000:0.0:1788851074.041728:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577424 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.041738:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577424 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.041766:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577424 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.041868:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577424 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.041877:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577424 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.041885:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546400 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851074.041890:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577424 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.041900:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577424 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.041914:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577424 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.041922:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577424 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851074.041974:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000791936:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 Request processed in 4636us (4863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851074.041983:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00100000:2.0:1788851074.044177:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851074.044291:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000792320 00000100:00100000:1.0:1788851074.044301:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000792320 00000100:00100000:1.0:1788851074.044363:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 127 00000100:00100000:1.0:1788851074.044374:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:10591:x1875746000792320:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788851074.044481:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957742b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.044500:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957742b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.044513:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957742b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.045157:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577432 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.045173:0:8079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec51 expref: 15 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.045181:0:8079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577432 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.045218:0:8079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec51 expref: 15 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.045234:0:8079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec51 expref: 15 pid: 5861 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851074.045250:0:8079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8079:1875746019677312:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851074.045385:0:8079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc1a42540 going to sleep for 11 seconds 00000100:00100000:2.0:1788851074.048275:0:8079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8079:1875746019677312:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851074.048322:0:8079:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577432 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851074.048986:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851074.049695:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000792448 00000100:00100000:0.0:1788851074.049704:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000792448 00010000:00010000:1.0:1788851074.052485:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec51 expref: 16 pid: 5861 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851074.052597:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:1.0:1788851074.052625:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+16:2354:x1875746000792448:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851074.052643:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851074.052650:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec51 expref: 16 pid: 5861 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.052665:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec51 expref: 16 pid: 5861 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.052697:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795773e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec51 expref: 16 pid: 5861 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.052716:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a9ba0794900) 00010000:00010000:1.0:1788851074.052722:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577432 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.052733:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577432 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.052748:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577432 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.052791:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851074.052847:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+15:2354:x1875746000792448:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 226us (3865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851074.053439:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 59 00010000:00010000:2.0:1788851074.053954:0:8079:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577432 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.053966:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577432 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851074.054172:0:8079:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788851074.054523:0:8079:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788851074.054565:0:8079:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788851074.054640:0:8079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8079:1875746019677440:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788851074.054705:0:8079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851074.054872:0:8079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8da53cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851074.054943:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019677440 00000100:00100000:0.0:1788851074.054965:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019677440 00000100:00100000:0.0:1788851074.055055:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788851074.055066:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8079:x1875746019677440:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788851074.055152:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8079:x1875746019677440:12345-0@lo:1000:mdt00_003.0 Request processed in 89us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851074.055159:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788851074.055424:0:8079:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788851074.055430:0:8079:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1788851074.055449:0:8079:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a9baef0c000, transno 4294967309 00000100:00100000:2.0:1788851074.055470:0:8079:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a9baef0df80 x1875746019676544/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788851089 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851074.055483:0:8079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8079:1875746019677440:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788851074.055925:0:8079:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1788851074.055984:0:8079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8079:1875746019677568:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788851074.056024:0:8079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851074.056047:0:8079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9840 going to sleep for 11 seconds 00000100:00100000:1.0:1788851074.056070:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019677568 00000100:00100000:1.0:1788851074.056076:0:5867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019677568 00000100:00100000:1.0:1788851074.056103:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788851074.056111:0:5867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8079:x1875746019677568:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788851074.056380:0:5867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8079:x1875746019677568:12345-0@lo:1000:mdt00_003.0 Request processed in 269us (355us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788851074.056387:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788851074.057402:0:8079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8079:1875746019677568:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788851074.057635:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577432 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.057647:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577432 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.057655:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577432 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.057662:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851074.057667:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577432 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.057676:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577432 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.057694:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a9ba0794900) 00010000:00010000:2.0:1788851074.057697:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788851074.057703:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577432 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.057709:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577432 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.057924:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577375 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.057943:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577375 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.057948:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577375 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.057953:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168fa00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851074.057956:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577375 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.057962:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577375 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.057971:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:2.0:1788851074.057973:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788851074.057980:0:8079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a87957737c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec35 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.057992:0:8079:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a87957737c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec35 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.058002:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a87957737c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec35 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.058038:0:8079:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a87957737c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec35 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851074.058052:0:8079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4133100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8079:1875746019677696:192.168.204.6@tcp:105: 00000100:00100000:2.0:1788851074.058187:0:8079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9840 going to sleep for 11 seconds 00000100:00100000:2.0:1788851074.061240:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851074.061365:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000792576 00000100:00100000:3.0:1788851074.061375:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000792576 00000100:00100000:3.0:1788851074.061441:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:3.0:1788851074.061452:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:10590:x1875746000792576:12345-192.168.204.6@tcp:49:lfs.0 00000100:00100000:3.0:1788851074.061599:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:10590:x1875746000792576:12345-192.168.204.6@tcp:49:lfs.0 Request processed in 148us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851074.061606:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:0.0:1788851074.062551:0:8079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4133100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8079:1875746019677696:192.168.204.6@tcp:105: 00010000:00010000:0.0:1788851074.062582:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577375 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062595:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577375 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062697:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577439 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062715:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577439 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062731:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577439 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062742:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577439 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062749:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577439 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062758:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577439 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062778:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851074.062822:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577439 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062831:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577439 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062844:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:0.0:1788851074.062859:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851074.062864:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577439 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062871:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577439 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062882:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957742b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062897:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957742b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062905:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957742b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062911:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851074.062914:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957742b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062920:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957742b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062928:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:0.0:1788851074.062931:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788851074.062941:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957742b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.062947:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a87957742b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851074.063203:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:10591:x1875746000792320:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 18829us (19034us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1788851074.063213:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 127 00000020:00080000:0.0:1788851074.063218:0:8079:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788851074.063382:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788851074.063387:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788851074.065616:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788851074.065633:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788851074.066454:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851074.066558:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851074.066805:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000793088 00000100:00100000:1.0:1788851074.066815:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000793088 00000100:00100000:0.0:1788851074.066943:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000792832 00000100:00100000:0.0:1788851074.066948:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000792832 00000100:00100000:0.0:1788851074.066984:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 32 00000100:00100000:0.0:1788851074.066995:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b912ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:10591:x1875746000792832:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788851074.067294:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 128 00000100:00100000:1.0:1788851074.067305:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:10590:x1875746000793088:12345-192.168.204.6@tcp:58:lfs.0 00000040:00080000:1.0:1788851074.067633:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788851074.067724:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:10590:x1875746000793088:12345-192.168.204.6@tcp:58:lfs.0 Request processed in 420us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851074.067732:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 128 00000004:00080000:0.0:1788851074.069070:0:5865:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788851074.069201:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788851074.069264:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577440 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.069293:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.069309:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.069319:0:5865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577440 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.069326:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577440 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.069333:0:5865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577440 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851074.069365:0:5865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788851074.069461:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b912ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+20:10591:x1875746000792832:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 2464us (3010us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788851074.069470:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 32 00000020:00080000:0.0:1788851074.069476:0:5865:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788851074.069665:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851074.069673:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577440 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.069682:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6000 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851074.069685:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577440 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.069694:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577440 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.069718:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8a9ba0794b00) 00010000:00010000:3.0:1788851074.069721:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788851074.069726:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577440 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.069737:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577440 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851074.069774:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851074.069776:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851074.069777:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851074.106849:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851074.107010:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000793216 00000100:00100000:2.0:1788851074.107021:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000793216 00000100:00100000:2.0:1788851074.107082:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 129 00000100:00100000:2.0:1788851074.107091:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+20:10593:x1875746000793216:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1788851074.107121:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851074.107144:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879577447 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec6d expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.107218:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957744e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.107233:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957744e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.107245:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957744e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.107260:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577455 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.107267:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.107273:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.107712:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a87957745c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.107738:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec2e expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.107748:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a87957745c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.107810:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec2e expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.107826:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec2e expref: 21 pid: 5863 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851074.107840:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4130700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019677824:192.168.204.6@tcp:104: 00000100:00100000:2.0:1788851074.107932:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788851074.111616:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851074.111969:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000793472 00000100:00100000:1.0:1788851074.111979:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000793472 00000100:00100000:1.0:1788851074.112039:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:1.0:1788851074.112051:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:5603:x1875746000793472:12345-192.168.204.6@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788851074.112367:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:5603:x1875746000793472:12345-192.168.204.6@tcp:35:ldlm_bl.0 Request processed in 317us (760us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788851074.112375:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:2.0:1788851074.113956:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4130700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019677824:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851074.113994:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a87957745c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851074.117895:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851074.118027:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000793600 00000100:00100000:2.0:1788851074.118037:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000793600 00010000:00010000:2.0:1788851074.118094:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec2e expref: 23 pid: 5863 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851074.118135:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:2.0:1788851074.118144:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b906b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:2354:x1875746000793600:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851074.118159:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851074.118183:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec2e expref: 23 pid: 5863 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.118196:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec2e expref: 23 pid: 5863 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.118221:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577367 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec2e expref: 23 pid: 5863 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.118238:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:2.0:1788851074.118244:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a87957745c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.118255:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a87957745c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.118264:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a87957745c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851074.118306:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851074.118366:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b906b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:2354:x1875746000793600:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 222us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851074.118373:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 60 00010000:00010000:1.0:1788851074.118919:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a87957745c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.118929:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a87957745c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851074.118976:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788851074.118981:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788851074.119004:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a87957745c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119029:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a87957745c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119041:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957744e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119046:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957744e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119052:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957744e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119058:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851074.119081:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957744e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119089:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957744e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119098:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:1.0:1788851074.119101:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851074.119105:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957744e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119111:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957744e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119123:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119128:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577455 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119140:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119146:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851074.119149:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119156:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577455 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119164:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8a9bbcd02200) 00010000:00010000:1.0:1788851074.119166:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851074.119169:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577455 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119174:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577455 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119211:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546e00/0x7ad3e1a879577447 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec6d expref: 22 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119226:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a87957745c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec6d expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851074.119234:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851074.119236:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851074.119238:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547a00, rc 0) 00000100:00100000:1.0:1788851074.119272:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:10593:x1875746000793216:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 12182us (12434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851074.119303:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 129 00010000:00010000:0.0:1788851074.835910:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788851075.037195:0:12124:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851075.037207:0:12124:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851075.037274:0:12124:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788851075.037280:0:12124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788851075.091145:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788851075.091157:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788851075.091201:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788851075.091209:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788851075.091353:0:11702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1df9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875746019677952:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788851075.091476:0:11702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc293c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851075.095345:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851075.097579:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000793728 00000100:00100000:0.0:1788851075.097597:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000793728 00000100:00100000:0.0:1788851075.097678:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 130 00000100:00100000:0.0:1788851075.097691:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:10604:x1875746000793728:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788851075.097730:0:5861:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788851075.097858:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:10604:x1875746000793728:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 171us (2526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851075.097866:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 130 00000100:00080000:3.0:1788851075.098114:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851075.103555:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851075.105571:0:11702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1df9880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875746019677952:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788851075.105826:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000793984 00000100:00100000:1.0:1788851075.105834:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000793984 00000100:00100000:1.0:1788851075.105895:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 131 00000100:00100000:1.0:1788851075.105906:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:10604:x1875746000793984:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851075.105928:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851075.105975:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577463 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec74 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851075.107539:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a87957746a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851075.107564:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a87957746a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851075.107581:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a87957746a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851075.107594:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788851075.108607:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577463 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec74 expref: 24 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851075.108631:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a87957746a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec74 expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851075.108659:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:1.0:1788851075.108662:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851075.108666:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59800, rc 0) 00000100:00100000:1.0:1788851075.108753:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1df8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:10604:x1875746000793984:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 2847us (5208us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788851075.108761:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 131 00000100:00100000:2.0:1788851075.118706:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851075.119639:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851075.119678:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000794368 00000100:00100000:2.0:1788851075.119688:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000794368 00000100:00100000:2.0:1788851075.119764:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:2.0:1788851075.119775:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:2352:x1875746000794368:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851075.119818:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851075.119848:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a87957746a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec74 expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851075.119867:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:2.0:1788851075.119873:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851075.119925:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:2352:x1875746000794368:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 151us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851075.119932:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:3.0:1788851075.120296:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000794240 00000100:00100000:3.0:1788851075.120302:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000794240 00000100:00100000:3.0:1788851075.120339:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 132 00000100:00100000:3.0:1788851075.120347:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:10604:x1875746000794240:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788851075.120434:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577478 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851075.120463:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851075.120476:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851075.120732:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851075.120741:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577478 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851075.120749:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577478 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851075.120755:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168fa00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851075.120760:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577478 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851075.120768:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577478 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851075.120777:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851075.120796:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788851075.120801:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577478 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851075.120808:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a879577478 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851075.120932:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:10604:x1875746000794240:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 584us (2235us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788851075.120946:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 132 00000040:00080000:1.0:1788851075.124376:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851075.124387:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851075.125704:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788851075.125729:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788851075.134767:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851075.135393:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000794624 00000100:00100000:1.0:1788851075.135415:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000794624 00000100:00100000:1.0:1788851075.135487:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:1.0:1788851075.135498:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:10604:x1875746000794624:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788851075.135769:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+24:10604:x1875746000794624:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 273us (1011us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1788851075.135817:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 34 00010000:00010000:3.0:1788851075.858025:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851076.114307:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019678208:0@lo:400:kworker.0 00000100:00100000:1.0:1788851076.114414:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851076.114499:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019678720:0@lo:400:kworker.0 00000100:00100000:1.0:1788851076.114547:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851076.114586:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788851076.114593:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019678080:0@lo:400:kworker.0 00000100:00100000:1.0:1788851076.114635:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851076.114684:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019678592:0@lo:400:kworker.0 00000100:00100000:2.0:1788851076.114857:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678720 00000100:00100000:2.0:1788851076.114866:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678720 00000100:00100000:2.0:1788851076.114941:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788851076.114953:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1875746019678720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851076.115016:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1875746019678720:12345-0@lo:400:kworker.0 Request processed in 66us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851076.115023:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1788851076.115048:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851076.115087:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678208 00000100:00100000:2.0:1788851076.115092:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678208 00000100:00100000:2.0:1788851076.115119:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788851076.115125:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019678208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851076.115159:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019678208:12345-0@lo:400:kworker.0 Request processed in 34us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851076.115165:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788851076.115186:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019678464:0@lo:400:kworker.0 00000100:00100000:2.0:1788851076.115219:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851076.115263:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788851076.115271:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019678336:0@lo:400:kworker.0 00000100:00100000:2.0:1788851076.115295:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851076.115312:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019678848:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851076.115336:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851076.115376:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678464 00000100:00100000:2.0:1788851076.115380:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678464 00000100:00100000:2.0:1788851076.115412:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788851076.115418:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875746019678464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851076.115455:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875746019678464:12345-0@lo:400:kworker.0 Request processed in 38us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851076.115462:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788851076.115481:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678080 00000100:00100000:2.0:1788851076.115485:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678080 00000100:00100000:2.0:1788851076.115507:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788851076.115513:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019678080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851076.115542:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019678080:12345-0@lo:400:kworker.0 Request processed in 29us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851076.115547:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:2.0:1788851076.115573:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851076.115609:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019678464:0@lo:400:kworker.0 00000100:00100000:2.0:1788851076.115643:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678336 00000100:00100000:2.0:1788851076.115647:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678336 00000100:00100000:2.0:1788851076.115674:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788851076.115680:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019678336:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788851076.115959:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851076.116389:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678848 00000100:00100000:0.0:1788851076.116397:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678848 00000100:00100000:2.0:1788851076.116438:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019678336:12345-0@lo:400:kworker.0 Request processed in 749us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851076.116446:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788851076.116456:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875746019678848:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851076.116470:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00002000:00000024:0.0:1788851076.116502:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851076.116505:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851076.116535:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678592 00000100:00100000:1.0:1788851076.116539:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019678208:0@lo:400:kworker.0 00000100:00100000:0.0:1788851076.116541:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875746019678848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851076.116542:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678592 00000100:00100000:0.0:1788851076.116551:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788851076.116555:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019678720:0@lo:400:kworker.0 00000100:00100000:1.0:1788851076.116580:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019678080:0@lo:400:kworker.0 00000100:00080000:0.0:1788851076.116581:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851076.116591:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788851076.116600:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019678592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851076.116633:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019678592:12345-0@lo:400:kworker.0 Request processed in 36us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851076.116638:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788851076.116686:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019678592:0@lo:400:kworker.0 00000100:00100000:3.0:1788851076.117428:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019678336:0@lo:400:kworker.0 00000100:00100000:3.0:1788851076.117456:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019678848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851076.627055:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788851076.627085:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019678976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851076.627175:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851076.627265:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019678976 00000100:00100000:3.0:1788851076.627274:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019678976 00000100:00100000:3.0:1788851076.627340:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788851076.627351:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875746019678976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851076.627393:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851076.627443:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875746019678976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851076.627452:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788851076.627552:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1df9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019678976:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788851076.667243:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1788851076.667269:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000040:00080000:2.0:1788851076.814065:0:12177:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788851076.814075:0:12177:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788851076.814129:0:12177:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788851076.814135:0:12177:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788851076.886011:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851077.000826:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851077.000920:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000794880 00000100:00100000:3.0:1788851077.000931:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000794880 00000100:00100000:3.0:1788851077.001005:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 133 00000100:00100000:3.0:1788851077.001025:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+24:10627:x1875746000794880:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851077.001055:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851077.001078:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a87957747f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec7b expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851077.001187:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577486 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851077.001231:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577486 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851077.001245:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577486 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851077.001258:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788851077.001422:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a87957747f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec7b expref: 27 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851077.001443:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577486 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec7b expref: 26 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851077.001451:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851077.001455:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788851077.001459:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168e600, rc 0) 00000100:00100000:3.0:1788851077.001529:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:10627:x1875746000794880:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 507us (761us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788851077.001537:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 133 00000100:00080000:0.0:1788851077.002568:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851077.007912:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851077.008152:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000795008 00000100:00100000:0.0:1788851077.008163:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000795008 00000100:00100000:0.0:1788851077.008238:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 134 00000100:00100000:0.0:1788851077.008250:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:10627:x1875746000795008:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:0.0:1788851077.008331:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577494 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851077.008350:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851077.008364:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851077.008404:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851077.008412:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577494 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851077.008418:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577494 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851077.008424:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851077.008429:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577494 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851077.008437:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577494 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851077.008463:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:0.0:1788851077.008466:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788851077.008472:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577494 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851077.008478:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577494 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851077.008560:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:10627:x1875746000795008:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 312us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851077.008568:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 134 00000100:00100000:1.0:1788851077.105918:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851077.110633:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000795136 00000100:00100000:2.0:1788851077.110651:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000795136 00000100:00100000:2.0:1788851077.111083:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:2.0:1788851077.111095:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000795136:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:2.0:1788851077.111117:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851077.111141:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d898dd74/0x7ad3e1a87957749b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec82 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788851077.111175:0:8281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9fb380, atime: 0x6a9fb380, ctime: 0x6a9fb380, blocks: 0xb 00010000:00010000:2.0:1788851077.111199:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=410s v=(0 0) 00010000:00010000:2.0:1788851077.111203:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851077.111213:0:8281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d898dd74/0x7ad3e1a87957749b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec82 expref: 7 pid: 8281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851077.111272:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d898dd74/0x7ad3e1a87957749b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec82 expref: 7 pid: 8281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851077.111287:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546e00, rc 0) 00000100:00100000:2.0:1788851077.113102:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000795136:12345-192.168.204.6@tcp:101:cat.0 Request processed in 1998us (7183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851077.113116:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00080000:0.0:1788851077.113450:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851077.118046:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851077.118149:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000795264 00000100:00100000:1.0:1788851077.118161:0:6713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000795264 00002000:00100000:1.0:1788851077.118243:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8a9bc1dfa680 x1875746000795264/t0(0) o3->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:143/0 lens 488/0 e 0 to 0 dl 1788851088 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788851077.118255:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bc1dfa680 with x1875746000795264 ext(0->4095) 00002000:00010000:1.0:1788851077.118263:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bc1dfa680 00000100:00100000:1.0:1788851077.118417:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:1.0:1788851077.118430:0:6713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2354:x1875746000795264:12345-192.168.204.6@tcp:3:cat.0 00000100:00100000:1.0:1788851077.121572:0:6713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2354:x1875746000795264:12345-192.168.204.6@tcp:3:cat.0 Request processed in 3134us (3527us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788851077.121587:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 3 00002000:00100000:1.0:1788851077.121599:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8a9bc1dfa680 x1875746000795264/t0(0) o3->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:143/0 lens 488/4536 e 0 to 0 dl 1788851088 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788851077.121612:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bc1dfa680 with x1875746000795264 ext(0->4095) 00002000:00010000:1.0:1788851077.121620:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bc1dfa680 00010000:00010000:0.0:1788851077.906032:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851078.145686:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851078.145740:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851078.145827:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851078.145865:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851078.145892:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851078.145929:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000795904 00000100:00100000:3.0:1788851078.145942:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000795904 00000100:00100000:3.0:1788851078.146016:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000795520 00000100:00100000:3.0:1788851078.146034:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000795520 00000100:00100000:3.0:1788851078.146065:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 150 00000100:00100000:3.0:1788851078.146076:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2351:x1875746000795904:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851078.146173:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2351:x1875746000795904:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 98us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851078.146181:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 150 00000100:00100000:3.0:1788851078.146210:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 151 00000100:00100000:3.0:1788851078.146218:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:2351:x1875746000795520:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851078.146247:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:2351:x1875746000795520:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851078.146253:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 151 00000100:00100000:1.0:1788851078.146466:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000795648 00000100:00100000:1.0:1788851078.146472:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000795648 00000100:00100000:1.0:1788851078.146518:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000795776 00000100:00100000:1.0:1788851078.146521:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000795776 00000100:00100000:1.0:1788851078.146545:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00100000:1.0:1788851078.146552:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2351:x1875746000795648:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851078.146592:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1df9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2351:x1875746000795648:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 40us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851078.146599:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00100000:1.0:1788851078.146614:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 74 00000100:00100000:1.0:1788851078.146620:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2351:x1875746000795776:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851078.146645:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2351:x1875746000795776:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 25us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851078.146651:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 74 00000100:00100000:0.0:1788851078.147770:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000795392 00000100:00100000:0.0:1788851078.147812:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000795392 00000100:00100000:0.0:1788851078.147868:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 294 00000100:00100000:0.0:1788851078.147877:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2351:x1875746000795392:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851078.147936:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2351:x1875746000795392:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 61us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851078.147943:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 294 00000100:00080000:0.0:1788851078.147984:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851078.147992:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788851078.246985:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788851078.246999:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788851078.247052:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788851078.247063:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788851078.930334:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788851079.308425:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1788851079.308444:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788851079.308462:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1788851079.318906:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000001:00080000:3.0:1788851079.318931:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1788851079.318954:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a9b91a05d80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788851079.318961:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9bc14ca000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a9b91a05000 00000020:00080000:3.0:1788851079.318965:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9bc14ca900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a9baf53b800 00000020:00080000:3.0:1788851079.318987:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:3.0:1788851079.318994:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1788851079.319639:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1788851079.319894:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1788851079.954243:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851080.979067:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851081.235572:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019679104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851081.235687:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851081.235806:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019679104 00000100:00100000:3.0:1788851081.235816:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019679104 00000100:00100000:3.0:1788851081.235885:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788851081.235895:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019679104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788851081.235946:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851081.235997:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019679104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851081.236005:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1788851081.236228:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851081.236451:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019679360:0@lo:400:kworker.0 00000100:00100000:3.0:1788851081.236485:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851081.236506:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851081.236512:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019679488:0@lo:400:kworker.0 00000100:00100000:3.0:1788851081.236531:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851081.236562:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019679360 00000100:00100000:3.0:1788851081.236566:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019679360 00000100:00100000:3.0:1788851081.236594:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019679488 00000100:00100000:3.0:1788851081.236597:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019679488 00000100:00100000:3.0:1788851081.236624:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788851081.236631:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019679360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851081.237924:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788851081.237943:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019679488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851081.238016:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019679488:12345-0@lo:400:kworker.0 Request processed in 82us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851081.238023:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788851081.238054:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019679232:0@lo:400:kworker.0 00000100:00100000:0.0:1788851081.238094:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851081.238127:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019679744:0@lo:400:kworker.0 00000100:00100000:0.0:1788851081.238162:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851081.238184:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851081.238190:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc18c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019679616:0@lo:400:kworker.0 00000100:00100000:0.0:1788851081.238215:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851081.238245:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019679232 00000100:00100000:0.0:1788851081.238254:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019679232 00000100:00100000:0.0:1788851081.238300:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788851081.238306:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019679232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851081.238340:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019679232:12345-0@lo:400:kworker.0 Request processed in 34us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851081.238346:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788851081.238378:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019679616 00000100:00100000:0.0:1788851081.238381:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019679616 00000100:00100000:0.0:1788851081.238412:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788851081.238417:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019679616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851081.238457:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019679616:12345-0@lo:400:kworker.0 Request processed in 40us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851081.238463:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788851081.238484:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019679744 00000100:00100000:0.0:1788851081.238487:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019679744 00000100:00100000:0.0:1788851081.238504:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788851081.238509:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019679744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851081.238534:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019679744:12345-0@lo:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851081.238540:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788851081.238575:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788851081.238581:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788851081.238603:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a9bafccaa00, transno 4294967304 00000100:00100000:0.0:1788851081.238619:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019679616:0@lo:400:kworker.0 00000100:00100000:0.0:1788851081.238630:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019679232:0@lo:400:kworker.0 00000100:00100000:0.0:1788851081.238639:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019679744:0@lo:400:kworker.0 00000100:00100000:0.0:1788851081.239091:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788851081.239098:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a9baef0df80, transno 4294967310 00000004:00080000:0.0:1788851081.239112:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788851081.239136:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019679104:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788851081.239192:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851081.239199:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851081.239236:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc18c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019679488:0@lo:400:kworker.0 00000100:00100000:0.0:1788851081.239249:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019679360:0@lo:400:kworker.0 00000100:00100000:3.0:1788851081.241016:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019679360:12345-0@lo:400:kworker.0 Request processed in 37us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851081.241038:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788851081.747248:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4131500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019679872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851081.747350:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851081.747874:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019679872 00000100:00100000:3.0:1788851081.747886:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019679872 00000100:00100000:3.0:1788851081.748606:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788851081.748619:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019679872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851081.748663:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851081.748759:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019679872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (1410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851081.748766:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788851081.749590:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4131500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019679872:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788851082.002397:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851083.030927:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851083.267511:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851083.267567:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851083.267606:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851083.267639:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851083.267664:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851083.267695:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000796544 00000100:00100000:3.0:1788851083.267707:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000796544 00000100:00100000:3.0:1788851083.267798:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000796160 00000100:00100000:3.0:1788851083.267802:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000796160 00000100:00100000:3.0:1788851083.267830:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 155 00000100:00100000:3.0:1788851083.267841:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000796544:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851083.267933:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4132680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2353:x1875746000796544:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 94us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851083.267940:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 155 00000100:00100000:3.0:1788851083.267960:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 156 00000100:00100000:3.0:1788851083.267966:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:2353:x1875746000796160:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851083.267992:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4131f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:2353:x1875746000796160:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851083.267997:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 156 00000100:00100000:3.0:1788851083.268020:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000796288 00000100:00100000:3.0:1788851083.268024:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000796288 00000100:00100000:3.0:1788851083.268056:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000796416 00000100:00100000:3.0:1788851083.268059:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000796416 00000100:00100000:3.0:1788851083.268107:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 76 00000100:00100000:3.0:1788851083.268115:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000796288:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851083.268142:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000796288:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 28us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851083.268168:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 76 00000100:00100000:3.0:1788851083.268182:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 77 00000100:00100000:3.0:1788851083.268188:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000796416:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851083.268213:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4132d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000796416:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851083.268219:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 77 00000100:00080000:3.0:1788851083.268234:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788851083.268238:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788851083.268241:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851083.268453:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000796032 00000100:00100000:1.0:1788851083.268458:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000796032 00000100:00100000:1.0:1788851083.268499:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 296 00000100:00100000:1.0:1788851083.268507:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000796032:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851083.268536:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000796032:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 30us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851083.268541:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 296 00000100:00100000:2.0:1788851083.737177:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851083.737454:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000796672 00000100:00100000:3.0:1788851083.737467:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000796672 00000100:00100000:3.0:1788851083.737538:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 135 00000100:00100000:3.0:1788851083.737549:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:10268:x1875746000796672:12345-192.168.204.6@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788851083.737822:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:10268:x1875746000796672:12345-192.168.204.6@tcp:60:lhsmtool_posix.0 Request processed in 275us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851083.737831:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 135 00000100:00100000:1.0:1788851083.747462:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851083.747819:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000796928 00000100:00100000:3.0:1788851083.747834:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000796928 00000100:00100000:3.0:1788851083.747914:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:3.0:1788851083.747927:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:10268:x1875746000796928:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788851083.750086:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:10268:x1875746000796928:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 2139us (2616us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788851083.750110:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 35 00010000:00010000:0.0:1788851084.050621:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788851084.377094:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1788851084.377118:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788851084.377209:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788851084.377225:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788851085.074877:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851086.100629:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788851086.167439:0:12380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 03:04:43 (1788851083) 00000100:00100000:0.0:1788851086.357119:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019680000:0@lo:400:kworker.0 00000100:00100000:0.0:1788851086.357193:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851086.357239:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019680512:0@lo:400:kworker.0 00000100:00100000:0.0:1788851086.357266:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851086.357294:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788851086.357300:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019680384:0@lo:400:kworker.0 00000100:00100000:0.0:1788851086.357324:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851086.357355:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019680128:0@lo:400:kworker.0 00000100:00100000:0.0:1788851086.357377:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851086.357396:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019680640:0@lo:400:kworker.0 00000100:00100000:0.0:1788851086.357416:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851086.357433:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851086.357439:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019680256:0@lo:400:kworker.0 00000100:00100000:0.0:1788851086.357458:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851086.357622:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680000 00000100:00100000:0.0:1788851086.357630:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680000 00000100:00100000:0.0:1788851086.357677:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788851086.357687:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019680000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851086.357740:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019680000:12345-0@lo:400:kworker.0 Request processed in 55us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851086.357766:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788851086.359072:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680512 00000100:00100000:0.0:1788851086.359081:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680512 00000100:00100000:0.0:1788851086.359124:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680128 00000100:00100000:0.0:1788851086.359128:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680128 00000100:00100000:0.0:1788851086.359141:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680256 00000100:00100000:0.0:1788851086.359143:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680256 00000100:00100000:0.0:1788851086.359160:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788851086.359167:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019680512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851086.359223:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019680512:12345-0@lo:400:kworker.0 Request processed in 57us (1956us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851086.359229:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788851086.359246:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788851086.359252:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019680128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851086.359276:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019680128:12345-0@lo:400:kworker.0 Request processed in 25us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851086.359282:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788851086.359293:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788851086.359298:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019680256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851086.359324:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019680256:12345-0@lo:400:kworker.0 Request processed in 25us (1863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851086.359329:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788851086.359349:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680384 00000100:00100000:0.0:1788851086.359352:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680384 00000100:00100000:0.0:1788851086.359378:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680640 00000100:00100000:0.0:1788851086.359382:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680640 00000100:00100000:0.0:1788851086.359402:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788851086.359417:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019680384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851086.359448:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019680384:12345-0@lo:400:kworker.0 Request processed in 33us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851086.359454:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788851086.359468:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788851086.359473:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019680640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851086.362676:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019680768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851086.362754:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851086.362870:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019680384:0@lo:400:kworker.0 00000100:00100000:1.0:1788851086.362900:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019680000:0@lo:400:kworker.0 00000100:00100000:1.0:1788851086.362914:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019680512:0@lo:400:kworker.0 00000100:00100000:3.0:1788851086.363183:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680768 00000100:00100000:3.0:1788851086.363190:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680768 00000100:00100000:3.0:1788851086.363242:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788851086.363253:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875746019680768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788851086.363293:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851086.363345:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875746019680768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851086.363353:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788851086.363389:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019680768:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788851086.364021:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788851086.364027:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851086.364031:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851086.364082:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019680256:0@lo:400:kworker.0 00000100:00100000:0.0:1788851086.364095:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019680128:0@lo:400:kworker.0 00000100:00100000:0.0:1788851086.364162:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019680640:12345-0@lo:400:kworker.0 Request processed in 4687us (6743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851086.364170:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788851086.366654:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019680640:0@lo:400:kworker.0 00000100:00100000:2.0:1788851086.868493:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788851086.880138:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019680896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851086.880224:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851086.882014:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019680896 00000100:00100000:3.0:1788851086.882043:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019680896 00000100:00100000:3.0:1788851086.882110:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788851086.882122:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019680896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851086.882165:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851086.882251:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019680896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851086.882257:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788851086.887247:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4130380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019680896:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788851087.124087:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851087.932611:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851087.932825:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000797184 00000100:00100000:0.0:1788851087.932836:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000797184 00000100:00100000:0.0:1788851087.932914:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 136 00000100:00100000:0.0:1788851087.932926:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:11336:x1875746000797184:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851087.932966:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851087.932993:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795774a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec89 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933081:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795774a9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933108:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795774a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933140:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795774a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933157:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795774b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933164:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795774b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933169:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795774b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933464:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795774b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933474:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795774b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933481:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795774b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851087.933491:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788851087.933680:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795774a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933688:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795774a9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933694:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795774a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933700:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851087.933713:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795774a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933721:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795774a9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933734:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a9ba0794100) 00010000:00010000:0.0:1788851087.933737:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851087.933743:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795774a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933749:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795774a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933762:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795774b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933768:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795774b0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933774:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795774b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.933779:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6a00 already unused, calling callback (ffffffffc20f24f0) 00000100:00080000:3.0:1788851087.933921:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788851087.935264:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795774b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.935277:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795774b0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.935293:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a9ba0794400) 00010000:00010000:0.0:1788851087.935296:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851087.935313:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795774b0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.935321:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795774b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.936909:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795774a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec89 expref: 16 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.937646:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795774b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec89 expref: 15 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.937662:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a9bbcd02f00) 00010000:00010000:0.0:1788851087.937665:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851087.937669:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7e00, rc 0) 00000100:00100000:0.0:1788851087.937848:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+15:11336:x1875746000797184:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 4923us (5245us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788851087.937859:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 136 00000100:00100000:2.0:1788851087.981328:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851087.981387:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851087.981491:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000797312 00000100:00100000:0.0:1788851087.981501:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000797312 00000100:00100000:0.0:1788851087.981589:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:0.0:1788851087.981601:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+15:2352:x1875746000797312:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851087.981619:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851087.981647:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795774b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec89 expref: 15 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851087.981667:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a9bbcd02f00) 00010000:00010000:0.0:1788851087.981673:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851087.981745:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:2352:x1875746000797312:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 147us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851087.981753:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:1.0:1788851087.981902:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000797440 00000100:00100000:1.0:1788851087.981908:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000797440 00000100:00100000:1.0:1788851087.981956:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 137 00000100:00100000:1.0:1788851087.981964:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:11336:x1875746000797440:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788851087.982047:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:11336:x1875746000797440:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 Request processed in 84us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851087.982054:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 137 00010000:00010000:3.0:1788851088.147510:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851088.386294:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851088.386342:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851088.386380:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851088.386424:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851088.386459:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000797952 00000100:00100000:1.0:1788851088.386469:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000797952 00000100:00100000:1.0:1788851088.386559:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 160 00000100:00100000:1.0:1788851088.386570:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2352:x1875746000797952:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851088.386664:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2352:x1875746000797952:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 96us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851088.386671:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 160 00000100:00100000:0.0:1788851088.387342:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000797824 00000100:00100000:0.0:1788851088.387352:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000797824 00000100:00100000:0.0:1788851088.387399:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000797696 00000100:00100000:0.0:1788851088.387403:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000797696 00000100:00100000:0.0:1788851088.387432:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 80 00000100:00100000:0.0:1788851088.387440:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2351:x1875746000797824:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851088.387516:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2351:x1875746000797824:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 77us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851088.387523:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 80 00000100:00100000:0.0:1788851088.387894:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 81 00000100:00100000:0.0:1788851088.387904:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2352:x1875746000797696:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851088.387936:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2352:x1875746000797696:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 35us (1555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851088.387942:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 81 00000100:00100000:3.0:1788851088.388374:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000797568 00000100:00100000:3.0:1788851088.388382:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000797568 00000100:00100000:3.0:1788851088.388426:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 298 00000100:00100000:3.0:1788851088.388434:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2351:x1875746000797568:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851088.388476:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2351:x1875746000797568:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 44us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851088.388483:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 298 00000100:00080000:3.0:1788851088.388875:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788851088.388881:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788851088.388884:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788851088.472257:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788851088.472268:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788851088.473046:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788851088.473057:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788851089.174215:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788851089.512819:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:3.0:1788851090.194445:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851090.611478:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851090.611567:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000798080 00000100:00100000:3.0:1788851090.611584:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000798080 00000100:00100000:3.0:1788851090.611685:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 138 00000100:00100000:3.0:1788851090.611699:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:11379:x1875746000798080:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851090.611738:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851090.611769:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a8795774c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec90 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.611886:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795774cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.611903:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795774cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.611917:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795774cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.611934:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.611941:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.611948:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612267:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795774cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612283:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795774cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612290:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795774cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612297:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851090.612302:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795774cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612311:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795774cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612326:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9ba0794a00) 00010000:00010000:3.0:1788851090.612329:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851090.612336:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795774cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612342:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795774cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612358:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612364:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612370:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612375:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168fa00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851090.612385:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612391:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612401:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a9b87c2ab00) 00010000:00010000:3.0:1788851090.612404:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851090.612407:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612413:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612457:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a8795774c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec90 expref: 14 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612467:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9ba0794a00) 00010000:00010000:3.0:1788851090.612470:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851090.612473:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a8795774c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec90 expref: 14 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.612483:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168ee00, rc 0) 00000100:00100000:3.0:1788851090.612575:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:11379:x1875746000798080:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 880us (1117us total) trans 0 rc 301/301 00000100:00100000:3.0:1788851090.612584:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 138 00000100:00080000:1.0:1788851090.612904:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851090.623741:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851090.624558:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000798336 00000100:00100000:2.0:1788851090.624577:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000798336 00000100:00100000:2.0:1788851090.624681:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 139 00000100:00100000:2.0:1788851090.624694:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:11379:x1875746000798336:12345-192.168.204.6@tcp:36:lfs.0 00010000:00010000:2.0:1788851090.624825:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851090.624879:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879576e51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfead0 expref: 13 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.624908:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9ba0794a00) 00010000:00010000:2.0:1788851090.624920:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851090.625409:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a8795774da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.625426:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a8795774da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.625438:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a8795774da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.625450:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795774e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.625458:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795774e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.625464:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795774e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851090.626639:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788851090.626656:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a8795774da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.626673:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a8795774da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.626681:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a8795774da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.626688:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851090.626693:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a8795774da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.626703:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a8795774da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.626720:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02a00) 00010000:00010000:2.0:1788851090.626723:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851090.626729:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a8795774da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.626735:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a8795774da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788851090.626757:0:5862:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c3ce7dc8 reply state 000000009d8e7cf6 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795774e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851090.626768:0:5862:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788851090.626943:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4133480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:11379:x1875746000798336:12345-192.168.204.6@tcp:36:lfs.0 Request processed in 2247us (3225us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788851090.626954:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 139 00010000:00010000:3.0:1788851090.640540:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795774e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.640591:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795774e1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.640600:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795774e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.640607:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851090.640613:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795774e1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.640623:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795774e1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.640645:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a9bbcd02000) 00010000:00010000:3.0:1788851090.640649:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851090.640655:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795774e1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.640662:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795774e1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851090.848686:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851090.848830:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000798464 00000100:00100000:3.0:1788851090.848845:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000798464 00000100:00100000:3.0:1788851090.848935:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 140 00000100:00100000:3.0:1788851090.848948:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:11387:x1875746000798464:12345-192.168.204.6@tcp:101:lctl.0 00010000:00010000:3.0:1788851090.848990:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851090.849021:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a8795774e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec97 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.849293:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.849311:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.849325:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851090.849372:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788851090.849378:0:8079:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788851090.849420:0:8079:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.849454:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a8795774e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec97 expref: 15 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.849473:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec97 expref: 14 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851090.849483:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b87c2ab00) 00010000:00010000:3.0:1788851090.849487:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851090.849490:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168fa00, rc 0) 00000100:00100000:3.0:1788851090.849569:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:11387:x1875746000798464:12345-192.168.204.6@tcp:101:lctl.0 Request processed in 623us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851090.849578:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 140 00000100:00100000:2.0:1788851090.966727:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851090.967140:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000798592 00000100:00100000:1.0:1788851090.967156:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000798592 00000100:00100000:1.0:1788851090.967264:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 141 00000100:00100000:1.0:1788851090.967279:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafeaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:11393:x1875746000798592:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1788851090.967306:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851090.967335:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795774f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfec9e expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.968003:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795774fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.968023:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795774fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.968037:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795774fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.968056:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879577504 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.968064:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879577504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.968071:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879577504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.968214:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957750b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.968223:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957750b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.968252:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957750b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851090.968568:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788851090.968574:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788851090.968601:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957750b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.968617:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795774fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.968624:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795774fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.968632:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795774fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.970576:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851090.970594:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795774fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.970611:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795774fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.970636:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b87c2ab00) 00010000:00010000:1.0:1788851090.970639:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851090.970645:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795774fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.970652:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795774fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.970855:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879577504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.970863:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879577504 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.970868:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879577504 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.970872:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851090.970877:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879577504 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.970883:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879577504 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.970891:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8a9b9199a600) 00010000:00010000:1.0:1788851090.970893:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851090.970896:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879577504 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.970902:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879577504 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.971042:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795774f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec9e expref: 16 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.971059:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957750b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec9e expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851090.971079:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:1.0:1788851090.971081:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788851090.971084:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59c00, rc 0) 00000100:00100000:0.0:1788851090.971255:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafeaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+15:11393:x1875746000798592:12345-192.168.204.6@tcp:101:bash.0 Request processed in 3977us (4551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851090.971267:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 141 00000100:00100000:1.0:1788851090.977086:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851090.977556:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000798848 00000100:00100000:3.0:1788851090.977570:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000798848 00000100:00100000:2.0:1788851090.977848:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 142 00000100:00100000:2.0:1788851090.977864:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+15:11393:x1875746000798848:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:2.0:1788851090.977888:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851090.977915:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577512 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeca5 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.978313:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879577519 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.978332:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879577519 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.978346:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879577519 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.979947:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577520 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.979983:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577520 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.979998:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577520 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788851090.985566:0:5863:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788851090.985833:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.985854:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.985870:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.985937:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879577519 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.985945:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879577519 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.985961:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879577519 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.985968:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851090.985973:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879577519 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.985980:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879577519 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.985994:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:2.0:1788851090.985997:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851090.986002:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879577519 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.986008:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a879577519 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788851090.986021:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f95f64a6 reply state 00000000e2a3df1a transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577520 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851090.986031:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788851090.986079:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577512 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeca5 expref: 18 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.986104:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeca5 expref: 17 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851090.986112:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9bbcd02900) 00010000:00010000:2.0:1788851090.986115:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851090.986118:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546000, rc 0) 00000100:00100000:2.0:1788851090.987858:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:11393:x1875746000798848:12345-192.168.204.6@tcp:101:bash.0 Request processed in 9989us (10907us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788851090.987871:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 142 00010000:00010000:1.0:1788851091.000868:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577520 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.000887:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577520 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.000896:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577520 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.000903:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851091.000909:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577520 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.000916:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577520 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.000935:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9bbcd02a00) 00010000:00010000:1.0:1788851091.000938:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851091.000943:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577520 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.000959:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577520 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851091.010160:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851091.010380:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000798976 00000100:00100000:0.0:1788851091.010391:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000798976 00000100:00100000:0.0:1788851091.010485:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:0.0:1788851091.010497:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000798976:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:0.0:1788851091.010522:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851091.010546:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019323163/0x7ad3e1a879577535 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfecac expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851091.010583:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851091.010607:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=423s v=(0 0) 00010000:00010000:0.0:1788851091.010612:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851091.010622:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019323163/0x7ad3e1a879577535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecac expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851091.010641:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019323163/0x7ad3e1a879577535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecac expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851091.010657:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6000, rc 0) 00000100:00100000:0.0:1788851091.010990:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000798976:12345-192.168.204.6@tcp:101:bash.0 Request processed in 494us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851091.010998:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00080000:1.0:1788851091.011070:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851091.023534:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851091.024155:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000799104 00000100:00100000:1.0:1788851091.024165:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000799104 00000100:00100000:1.0:1788851091.024227:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:1.0:1788851091.024238:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:11393:x1875746000799104:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1788851091.024259:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851091.024280:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfecb3 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.024316:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000019323163/0x7ad3e1a879577535 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecac expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.024327:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851091.024332:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851091.024338:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.024374:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000019323163/0x7ad3e1a879577535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecac expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.024389:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000019323163/0x7ad3e1a879577535 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecac expref: 7 pid: 6704 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851091.024404:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6707:1875746019681024:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851091.025278:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc29300 going to sleep for 11 seconds 00000100:00100000:1.0:1788851091.032106:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d75f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6707:1875746019681024:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851091.032165:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 7 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.032188:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58800, rc 0) 00000100:00100000:1.0:1788851091.032246:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:11393:x1875746000799104:12345-192.168.204.6@tcp:101:bash.0 Request processed in 8010us (8723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851091.032256:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:3.0:1788851091.032916:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851091.032984:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000799232 00000100:00100000:2.0:1788851091.032992:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000799232 00010000:00010000:2.0:1788851091.033026:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000019323163/0x7ad3e1a879577535 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecac expref: 7 pid: 6704 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851091.033066:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:2.0:1788851091.033075:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4130380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000799232:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851091.033095:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851091.033119:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019323163/0x7ad3e1a879577535 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecac expref: 7 pid: 6704 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.033132:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019323163/0x7ad3e1a879577535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecac expref: 7 pid: 6704 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.033156:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019323163/0x7ad3e1a879577535 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecac expref: 7 pid: 6704 timeout: 523 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.033181:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851091.033186:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851091.033194:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 6 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.033205:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 6 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.033239:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 6 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851091.033253:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5846:1875746019681152:192.168.204.6@tcp:105: 00000100:00100000:2.0:1788851091.033315:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9baefde840 going to sleep for 11 seconds 00000100:00100000:2.0:1788851091.037499:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851091.037567:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000799488 00000100:00100000:3.0:1788851091.037576:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000799488 00000100:00100000:3.0:1788851091.037632:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:3.0:1788851091.037643:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:11393:x1875746000799488:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:3.0:1788851091.038091:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:11393:x1875746000799488:12345-192.168.204.6@tcp:35:bash.0 Request processed in 449us (599us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788851091.038099:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:1.0:1788851091.038996:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5846:1875746019681152:192.168.204.6@tcp:105: 00010000:00010000:1.0:1788851091.039023:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851091.039074:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4130380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000799232:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 6000us (6160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851091.039085:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:2.0:1788851091.165772:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851091.165914:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000799744 00000100:00100000:3.0:1788851091.165925:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000799744 00000100:00100000:3.0:1788851091.165998:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 143 00000100:00100000:3.0:1788851091.166009:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:11403:x1875746000799744:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851091.166040:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851091.166065:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577543 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfecba expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851091.166182:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788851091.166315:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577543 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecba expref: 20 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.166330:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b87c2ab00) 00010000:00010000:3.0:1788851091.166333:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851091.166339:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577543 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecba expref: 20 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.166352:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f800, rc 0) 00000100:00100000:3.0:1788851091.166425:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:11403:x1875746000799744:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 418us (665us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1788851091.166447:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 143 00000100:00100000:1.0:1788851091.173481:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851091.173838:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000800000 00000100:00100000:3.0:1788851091.173849:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000800000 00000100:00100000:3.0:1788851091.173898:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 37 00000100:00100000:3.0:1788851091.173908:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:11403:x1875746000800000:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1788851091.174416:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+20:11403:x1875746000800000:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 508us (944us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788851091.174425:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 37 00010000:00010000:3.0:1788851091.221985:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851091.349365:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851091.351729:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000800128 00000100:00100000:3.0:1788851091.351745:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000800128 00000100:00100000:3.0:1788851091.351874:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 144 00000100:00100000:3.0:1788851091.351886:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+20:11409:x1875746000800128:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851091.351917:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851091.351950:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577551 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfecc1 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.352026:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577558 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.352044:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.352067:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851091.352296:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788851091.352329:0:8079:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788851091.352353:0:8079:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.352382:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879577551 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecc1 expref: 22 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.352534:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577558 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecc1 expref: 21 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.352544:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:3.0:1788851091.352547:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851091.352551:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168ee00, rc 0) 00000100:00100000:3.0:1788851091.354723:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:11409:x1875746000800128:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 2827us (5357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851091.354736:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 144 00000100:00100000:2.0:1788851091.371554:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851091.371645:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000800384 00000100:00100000:3.0:1788851091.371656:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000800384 00000100:00100000:3.0:1788851091.371726:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 145 00000100:00100000:3.0:1788851091.371738:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:11409:x1875746000800384:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851091.371762:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851091.371826:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957755f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfecc8 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.371932:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577566 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.371958:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.371993:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577566 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851091.372007:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788851091.372163:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957755f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecc8 expref: 24 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.372185:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577566 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecc8 expref: 23 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.372195:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9bbcd02900) 00010000:00010000:3.0:1788851091.372198:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851091.372202:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f000, rc 0) 00000100:00100000:3.0:1788851091.372271:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:11409:x1875746000800384:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 536us (729us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788851091.372278:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 145 00000100:00100000:1.0:1788851091.377537:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851091.379113:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000800640 00000100:00100000:3.0:1788851091.379135:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000800640 00000100:00100000:3.0:1788851091.379216:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 146 00000100:00100000:3.0:1788851091.379228:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:11409:x1875746000800640:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851091.379258:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851091.379284:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577574 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeccf expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.379432:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a87957757b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.379472:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a87957757b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.379488:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a87957757b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851091.379505:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788851091.379664:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577574 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeccf expref: 26 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.379688:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a87957757b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeccf expref: 25 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.379698:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9bbcd02900) 00010000:00010000:3.0:1788851091.379701:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788851091.379705:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4600, rc 0) 00000100:00100000:3.0:1788851091.390306:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+25:11409:x1875746000800640:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 11057us (12758us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788851091.390325:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 146 00000100:00100000:2.0:1788851091.395358:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851091.395538:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000800768 00000100:00100000:1.0:1788851091.395552:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000800768 00000100:00100000:1.0:1788851091.395637:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:1.0:1788851091.395649:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+25:2352:x1875746000800768:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851091.395668:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851091.395699:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f000/0x7ad3e1a879577566 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecc8 expref: 25 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.395726:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9bbcd02900) 00010000:00010000:1.0:1788851091.395732:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851091.395826:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+24:2352:x1875746000800768:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 179us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851091.395855:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:1.0:1788851091.402068:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851091.402427:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000800896 00000100:00100000:3.0:1788851091.402441:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000800896 00000100:00100000:3.0:1788851091.402517:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:3.0:1788851091.402529:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000800896:12345-192.168.204.6@tcp:1:lfs.0 00010000:00010000:3.0:1788851091.402586:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000740f5953/0x7ad3e1a879577589 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.402611:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 6 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.402635:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788851091.402640:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851091.402646:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000740f5953/0x7ad3e1a879577589 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.402688:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 6 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.402704:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 6 pid: 6707 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851091.402722:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4131500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1875746019681280:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851091.402863:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851091.419826:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851091.419951:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000801024 00000100:00100000:1.0:1788851091.419966:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000801024 00002000:00100000:1.0:1788851091.420040:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8a9b87ca3b80 x1875746000801024/t0(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:157/0 lens 504/0 e 0 to 0 dl 1788851102 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788851091.420053:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9b87ca3b80 with x1875746000801024 ext(0->12) 00010000:00010000:1.0:1788851091.420065:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 7 pid: 6707 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.420098:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 7 pid: 6707 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851091.420107:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a9b87ca3b80 00000100:00100000:1.0:1788851091.420138:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:1.0:1788851091.420150:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2354:x1875746000801024:12345-192.168.204.6@tcp:4:lfs.0 00000100:00100000:0.0:1788851091.420550:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4131500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1875746019681280:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788851091.420584:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000740f5953/0x7ad3e1a879577589 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851091.421490:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:2354:x1875746000801024:12345-192.168.204.6@tcp:4:lfs.0 Request processed in 1332us (1668us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788851091.421508:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 2 00002000:00100000:1.0:1788851091.421521:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8a9b87ca3b80 x1875746000801024/t4294967305(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:157/0 lens 504/448 e 0 to 0 dl 1788851102 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788851091.421565:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9b87ca3b80 with x1875746000801024 ext(0->12) 00010000:00010000:1.0:1788851091.421587:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 9 pid: 6707 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.421624:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 9 pid: 6707 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851091.421634:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a9b87ca3b80 00000100:00100000:2.0:1788851091.431321:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851091.431770:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000801152 00000100:00100000:3.0:1788851091.431831:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000801152 00010000:00010000:3.0:1788851091.431890:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 9 pid: 6707 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851091.431934:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 62 00000100:00100000:3.0:1788851091.431961:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:2353:x1875746000801152:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851091.431980:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788851091.432007:0:6721:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788851091.432011:0:6721:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788851090 00002000:00010000:3.0:1788851091.432013:0:6721:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788851091 00002000:00010000:3.0:1788851091.432032:0:6721:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788851090 00010000:00010000:3.0:1788851091.432041:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 9 pid: 6707 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.432059:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 9 pid: 6707 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.432105:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a87957753c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecb3 expref: 9 pid: 6707 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.432128:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851091.432133:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851091.432140:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000740f5953/0x7ad3e1a879577589 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.432153:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000740f5953/0x7ad3e1a879577589 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.432198:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851091.432269:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2353:x1875746000801152:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 311us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851091.432278:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 62 00010000:00010000:2.0:1788851091.433514:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000740f5953/0x7ad3e1a879577589 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.433534:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000740f5953/0x7ad3e1a879577589 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.433594:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000740f5953/0x7ad3e1a879577589 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.433603:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000740f5953/0x7ad3e1a879577589 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.433612:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000740f5953/0x7ad3e1a879577589 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.433619:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4a00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851091.433624:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000740f5953/0x7ad3e1a879577589 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.433634:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000740f5953/0x7ad3e1a879577589 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.433653:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000740f5953/0x7ad3e1a879577589 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.433662:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000740f5953/0x7ad3e1a879577589 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851091.433769:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000800896:12345-192.168.204.6@tcp:1:lfs.0 Request processed in 31239us (31713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851091.433809:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:3.0:1788851091.437598:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851091.437655:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000801408 00000100:00100000:3.0:1788851091.437668:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000801408 00000100:00100000:3.0:1788851091.437731:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:3.0:1788851091.437744:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b912adc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+24:11409:x1875746000801408:12345-192.168.204.6@tcp:35:lfs.0 00000004:00010000:3.0:1788851091.437870:0:5864:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a87957757b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeccf expref: 24 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851091.438203:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1788851091.438250:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1788851091.438884:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1788851091.438970:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577590 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.438991:0:5864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577527 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeca5 expref: 28 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.439001:0:5864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577590 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.439045:0:5864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeca5 expref: 28 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.439064:0:5864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577527 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeca5 expref: 28 pid: 5863 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851091.439081:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4131500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1875746019681408:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851091.439188:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851091.450684:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851091.450775:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000801536 00000100:00100000:2.0:1788851091.450817:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000801536 00010000:00010000:2.0:1788851091.450870:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577527 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeca5 expref: 29 pid: 5863 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851091.450916:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:2.0:1788851091.450926:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+29:2354:x1875746000801536:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851091.450955:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851091.450964:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577527 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeca5 expref: 29 pid: 5863 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.450980:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577527 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeca5 expref: 29 pid: 5863 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.451006:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9bbcd02900) 00010000:00010000:2.0:1788851091.451013:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577590 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.451023:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577590 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.451031:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577590 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851091.451056:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851091.451126:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+29:2354:x1875746000801536:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 201us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851091.451133:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 63 00010000:00010000:0.0:1788851091.464177:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577527 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeca5 expref: 28 pid: 5863 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851091.464212:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4131500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5864:1875746019681408:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788851091.464248:0:5864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577590 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.464370:0:5864:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577590 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.464380:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577590 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788851091.464559:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788851091.464814:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1788851091.464964:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ee2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875746019681536:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788851091.465048:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851091.465102:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc29480 going to sleep for 11 seconds 00000100:00100000:0.0:1788851091.465518:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019681536 00000100:00100000:0.0:1788851091.465534:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019681536 00000100:00100000:0.0:1788851091.465631:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788851091.465641:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851091.465645:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1875746019681536:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788851091.466008:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5864:x1875746019681536:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 365us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851091.466017:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788851091.466037:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ee2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875746019681536:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788851091.469648:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788851091.469800:0:5864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875746019681664:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788851091.469890:0:5864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851091.471545:0:5864:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b9864d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788851091.474360:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019681792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851091.474467:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851091.474579:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019681792 00000100:00100000:3.0:1788851091.474590:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019681792 00000100:00100000:3.0:1788851091.474675:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788851091.474688:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019681792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788851091.474751:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851091.474836:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019681792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851091.474844:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788851091.474900:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019681792:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788851091.475356:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851091.477000:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019682176:0@lo:400:kworker.0 00000100:00100000:3.0:1788851091.477079:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851091.477120:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851091.477126:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019682304:0@lo:400:kworker.0 00000100:00100000:3.0:1788851091.477149:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851091.477179:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019682176 00000100:00100000:3.0:1788851091.477186:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019682176 00000100:00100000:3.0:1788851091.477239:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019682304 00000100:00100000:3.0:1788851091.477241:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019682304 00000100:00100000:3.0:1788851091.477266:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788851091.477274:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019682176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851091.477323:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019682176:12345-0@lo:400:kworker.0 Request processed in 49us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851091.477419:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019682048:0@lo:400:kworker.0 00000100:00100000:0.0:1788851091.477451:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851091.477465:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851091.477470:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019681920:0@lo:400:kworker.0 00000100:00100000:0.0:1788851091.477494:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851091.477606:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788851091.477623:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019682048 00000100:00100000:3.0:1788851091.477626:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019682048 00000100:00100000:3.0:1788851091.477641:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788851091.477646:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019682304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851091.477675:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019682304:12345-0@lo:400:kworker.0 Request processed in 28us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851091.477681:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788851091.477711:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788851091.477716:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019682048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851091.477756:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4131500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019682048:12345-0@lo:400:kworker.0 Request processed in 39us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851091.477762:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1788851091.477814:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851091.477846:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019682304:0@lo:400:kworker.0 00000100:00100000:3.0:1788851091.477856:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019682176:0@lo:400:kworker.0 00000100:00100000:1.0:1788851091.477966:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019681920 00000100:00100000:1.0:1788851091.477971:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019681920 00000100:00100000:1.0:1788851091.478001:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788851091.478007:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019681920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851091.478040:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019681920:12345-0@lo:400:kworker.0 Request processed in 34us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851091.478047:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788851091.478129:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019681920:0@lo:400:kworker.0 00000100:00100000:0.0:1788851091.478139:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019682048:0@lo:400:kworker.0 00000100:00100000:2.0:1788851091.478553:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019681664 00000100:00100000:2.0:1788851091.478567:0:5867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019681664 00000100:00100000:2.0:1788851091.478604:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788851091.478612:0:5867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5864:x1875746019681664:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788851091.478908:0:5867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5864:x1875746019681664:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 297us (9019us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788851091.478916:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788851091.479086:0:5864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcca300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5864:1875746019681664:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788851091.479177:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1788851091.479231:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577590 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.479244:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577590 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.479253:0:5864:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577590 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.479259:0:5864:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851091.479265:0:5864:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577590 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.479273:0:5864:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577590 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.479293:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9bbcd02900) 00010000:00010000:1.0:1788851091.479296:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788851091.479301:0:5864:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577590 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.479308:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577590 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788851091.480485:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788851091.480618:0:5864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1788851091.480633:0:5864:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424421850358ns, next at 425421847280ns, rc = 0 00000001:00080000:1.0:1788851091.480642:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1788851091.480699:0:5864:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9bbcd02900) 00010000:00010000:1.0:1788851091.480716:0:5864:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788851091.480726:0:5864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a87957757b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeccf expref: 32 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851091.480886:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b912adc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+31:11409:x1875746000801408:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 43144us (43301us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1788851091.480896:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 38 00000020:00080000:1.0:1788851091.480902:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788851091.491982:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851091.492072:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000801664 00000100:00100000:3.0:1788851091.492195:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000801664 00000100:00100000:3.0:1788851091.492315:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 147 00000100:00100000:3.0:1788851091.492340:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+31:11409:x1875746000801664:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851091.492370:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851091.492407:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577597 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfecd6 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.492486:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577597 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecd6 expref: 32 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.492503:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577597 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecd6 expref: 32 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.492525:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:3.0:1788851091.492528:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788851091.492532:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a5c00, rc 0) 00000100:00100000:3.0:1788851091.492643:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+32:11409:x1875746000801664:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 317us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851091.492665:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 147 00000100:00100000:2.0:1788851091.504609:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851091.506731:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000801920 00000100:00100000:3.0:1788851091.506751:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000801920 00000100:00100000:2.0:1788851091.507138:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:2.0:1788851091.507155:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+32:11409:x1875746000801920:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1788851091.507724:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+33:11409:x1875746000801920:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 572us (3128us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1788851091.507733:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:0.0:1788851091.599886:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851091.599998:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000802176 00000100:00100000:3.0:1788851091.600014:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000802176 00000100:00100000:3.0:1788851091.600094:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 148 00000100:00100000:3.0:1788851091.600106:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+33:11419:x1875746000802176:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851091.600134:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851091.600160:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a87957759e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfecdd expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851091.600281:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788851091.600739:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a87957759e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecdd expref: 35 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.600755:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b87c2ab00) 00010000:00010000:3.0:1788851091.600759:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851091.600764:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a87957759e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecdd expref: 35 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.600968:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4e00, rc 0) 00000100:00100000:2.0:1788851091.602057:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:11419:x1875746000802176:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1944us (2177us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788851091.602070:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 148 00000100:00100000:0.0:1788851091.607597:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851091.608052:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000802304 00000100:00100000:3.0:1788851091.608066:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000802304 00000100:00100000:3.0:1788851091.608151:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 149 00000100:00100000:3.0:1788851091.608163:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:11419:x1875746000802304:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:3.0:1788851091.608262:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795775ac lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608304:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795775ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608319:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795775ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608337:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795775b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608344:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795775b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608351:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795775b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608470:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608479:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608486:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851091.608548:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608564:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795775ac lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608573:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795775ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608592:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795775ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608599:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851091.608605:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795775ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608614:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795775ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608628:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:3.0:1788851091.608632:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851091.608637:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795775ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608644:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795775ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608661:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795775b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608667:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795775b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608674:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795775b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608679:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851091.608682:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795775b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608697:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795775b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608706:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9b87c2a900) 00010000:00010000:3.0:1788851091.608708:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851091.608712:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795775b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608718:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795775b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608737:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608743:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608749:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608755:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851091.608757:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608763:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608770:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:3.0:1788851091.608772:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851091.608775:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.608823:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851091.608907:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:11419:x1875746000802304:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 746us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851091.608916:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 149 00000100:00100000:0.0:1788851091.612208:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851091.612318:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000802560 00000100:00100000:1.0:1788851091.612342:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000802560 00000100:00100000:1.0:1788851091.612414:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 40 00000100:00100000:1.0:1788851091.612425:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:11419:x1875746000802560:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:1.0:1788851091.612726:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+35:11419:x1875746000802560:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 301us (529us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788851091.612734:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 40 00000100:00100000:0.0:1788851091.681991:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851091.682125:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000802816 00000100:00100000:1.0:1788851091.682138:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000802816 00000100:00100000:1.0:1788851091.682227:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 150 00000100:00100000:1.0:1788851091.682240:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+35:11422:x1875746000802816:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851091.682271:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851091.682299:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a8795775c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfece4 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682415:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795775c8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682432:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795775c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682466:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795775c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682481:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795775cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682488:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795775cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682506:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795775cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682646:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795775d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682667:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795775d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682675:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795775d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851091.682685:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788851091.682841:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795775c8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682850:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795775c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682858:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795775c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682864:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851091.682876:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795775c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682886:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795775c8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682900:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:1.0:1788851091.682903:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851091.682908:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795775c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682916:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795775c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682931:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795775cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682949:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795775cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682956:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795775cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682961:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851091.682965:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795775cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682971:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795775cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682980:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9b9199a600) 00010000:00010000:1.0:1788851091.682982:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851091.682991:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795775cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.682998:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795775cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.683048:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a8795775c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfece4 expref: 38 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.683062:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795775d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfece4 expref: 37 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851091.683070:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:1.0:1788851091.683072:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851091.683075:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58200, rc 0) 00000100:00100000:1.0:1788851091.683143:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+37:11422:x1875746000802816:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 906us (1167us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1788851091.683151:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 150 00000100:00100000:0.0:1788851091.686592:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851091.686774:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000802944 00000100:00100000:3.0:1788851091.686813:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000802944 00000100:00100000:3.0:1788851091.686885:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 151 00000100:00100000:3.0:1788851091.686896:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+37:11422:x1875746000802944:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:3.0:1788851091.686987:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.687007:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.687020:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.687060:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.687068:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.687075:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.687082:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851091.687087:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.687112:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.687126:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:3.0:1788851091.687129:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851091.687135:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851091.687141:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795775e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851091.689525:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+37:11422:x1875746000802944:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 2611us (2926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851091.689545:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 151 00000100:00100000:0.0:1788851091.699565:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851091.700835:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000803200 00000100:00100000:1.0:1788851091.700852:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000803200 00000100:00100000:1.0:1788851091.700944:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:1.0:1788851091.700957:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+37:11422:x1875746000803200:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:1.0:1788851091.701273:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+38:11422:x1875746000803200:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 319us (1722us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788851091.701281:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:0.0:1788851091.986451:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019682432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851091.986550:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851091.995968:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019682432 00000100:00100000:3.0:1788851091.995986:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019682432 00000100:00100000:3.0:1788851091.996091:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788851091.996102:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875746019682432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851091.996130:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851091.996252:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875746019682432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 151us (9701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851091.996272:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788851091.996327:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019682432:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788851092.055332:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1788851092.055360:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:1.0:1788851092.100888:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851092.101201:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000803456 00000100:00100000:2.0:1788851092.101217:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000803456 00000100:00100000:2.0:1788851092.101321:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 152 00000100:00100000:2.0:1788851092.101335:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+38:11453:x1875746000803456:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:2.0:1788851092.101365:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851092.101404:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795775eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeceb expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.101540:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a8795775f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.101574:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a8795775f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.101590:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a8795775f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851092.101605:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788851092.101824:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795775eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeceb expref: 41 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.101847:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a8795775f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeceb expref: 40 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.101855:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:2.0:1788851092.101858:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851092.101862:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547200, rc 0) 00000100:00100000:2.0:1788851092.101955:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+40:11453:x1875746000803456:12345-192.168.204.6@tcp:101:cat.0 Request processed in 623us (1083us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788851092.101963:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 152 00000100:00080000:3.0:1788851092.102814:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851092.108963:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851092.109406:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000803584 00000100:00100000:3.0:1788851092.109430:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000803584 00000100:00100000:3.0:1788851092.109531:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:3.0:1788851092.109561:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b906b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+40:2352:x1875746000803584:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851092.109580:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851092.109610:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a8795775f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeceb expref: 40 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.109635:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:3.0:1788851092.109640:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851092.109710:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b906b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+39:2352:x1875746000803584:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 152us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851092.109719:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:1.0:1788851092.115838:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851092.117935:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000803840 00000100:00100000:3.0:1788851092.118039:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000803840 00000100:00100000:3.0:1788851092.118588:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:3.0:1788851092.124582:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+39:11453:x1875746000803840:12345-192.168.204.6@tcp:35:cat.0 00000100:00100000:3.0:1788851092.126777:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+40:11453:x1875746000803840:12345-192.168.204.6@tcp:35:cat.0 Request processed in 8161us (10940us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788851092.126811:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 42 00010000:00010000:2.0:1788851092.242392:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851092.276589:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851092.276759:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000804096 00000100:00100000:3.0:1788851092.276774:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000804096 00000100:00100000:3.0:1788851092.276901:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 153 00000100:00100000:3.0:1788851092.276914:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+40:11459:x1875746000804096:12345-192.168.204.6@tcp:101:dd.0 00010000:00010000:3.0:1788851092.276964:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851092.276968:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788851092.277006:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ee00/0x7ad3e1a879577558 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecc1 expref: 40 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.277055:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:3.0:1788851092.277605:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851092.277631:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577600 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfecf2 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.277775:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.277854:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795775d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfece4 expref: 40 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.277863:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.277908:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795775d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfece4 expref: 40 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.277937:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795775d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfece4 expref: 40 pid: 5863 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851092.278011:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875746019682560:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851092.278400:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788851092.285315:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851092.287306:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875746019682560:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851092.287359:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851092.288843:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000804224 00000100:00100000:1.0:1788851092.288881:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000804224 00010000:00010000:1.0:1788851092.288952:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795775d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfece4 expref: 41 pid: 5863 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851092.289005:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 64 00000100:00100000:1.0:1788851092.289017:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+41:2354:x1875746000804224:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851092.289035:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851092.289044:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795775d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfece4 expref: 41 pid: 5863 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.289060:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795775d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfece4 expref: 41 pid: 5863 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.289206:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795775d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfece4 expref: 41 pid: 5863 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.289225:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:1.0:1788851092.289241:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.289252:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.289260:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851092.289295:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851092.289442:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+40:2354:x1875746000804224:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 425us (4141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851092.289461:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 64 00010000:00010000:2.0:1788851092.289809:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.289819:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851092.289853:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788851092.290081:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577600 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecf2 expref: 41 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.290102:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecf2 expref: 40 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.290111:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:2.0:1788851092.290114:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788851092.290117:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4600, rc 0) 00000100:00100000:2.0:1788851092.290154:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+40:11459:x1875746000804096:12345-192.168.204.6@tcp:101:dd.0 Request processed in 13243us (13759us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788851092.290163:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 153 00000100:00100000:1.0:1788851092.295302:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851092.295515:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000804480 00000100:00100000:2.0:1788851092.295529:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000804480 00000100:00100000:2.0:1788851092.295609:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 154 00000100:00100000:2.0:1788851092.295622:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+40:11459:x1875746000804480:12345-192.168.204.6@tcp:36:dd.0 00010000:00010000:2.0:1788851092.296139:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577615 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.296162:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.296177:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851092.296493:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788851092.296540:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000400ce96c reply state 000000002b60c747 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851092.296552:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788851092.297733:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+43:11459:x1875746000804480:12345-192.168.204.6@tcp:36:dd.0 Request processed in 2101us (2774us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788851092.297745:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 154 00000020:00080000:2.0:1788851092.297753:0:5863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788851092.308193:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.308219:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577615 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.308305:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577615 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.308314:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851092.308320:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577615 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.308329:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577615 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.308351:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:2.0:1788851092.308355:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851092.308360:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577615 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.308367:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577615 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851092.573633:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851092.573952:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000804608 00000100:00100000:0.0:1788851092.573966:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000804608 00000100:00100000:0.0:1788851092.574048:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 155 00000100:00100000:0.0:1788851092.574060:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+42:11473:x1875746000804608:12345-192.168.204.6@tcp:101:stat.0 00010000:00010000:0.0:1788851092.574091:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851092.574120:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a87957761c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfecf9 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.574207:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577623 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.574236:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.574251:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.574270:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a87957762a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.574276:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a87957762a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.574282:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a87957762a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.574395:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.574506:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecf2 expref: 43 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.574515:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577631 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.574558:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecf2 expref: 43 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.574575:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecf2 expref: 43 pid: 5861 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851092.574591:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb39b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019682688:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851092.574993:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b9864d780 going to sleep for 11 seconds 00000100:00100000:0.0:1788851092.583897:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851092.584022:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000804864 00000100:00100000:2.0:1788851092.584051:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000804864 00000100:00100000:2.0:1788851092.584131:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:2.0:1788851092.584143:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+44:5603:x1875746000804864:12345-192.168.204.6@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788851092.584585:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+45:5603:x1875746000804864:12345-192.168.204.6@tcp:35:ldlm_bl.0 Request processed in 442us (700us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788851092.584595:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:3.0:1788851092.585268:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb39b3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019682688:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851092.585319:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851092.588724:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851092.588990:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000804992 00000100:00100000:3.0:1788851092.589014:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000804992 00010000:00010000:3.0:1788851092.589079:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecf2 expref: 45 pid: 5861 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851092.589127:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 65 00000100:00100000:3.0:1788851092.589139:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+45:2354:x1875746000804992:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851092.589157:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851092.589164:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecf2 expref: 45 pid: 5861 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.589177:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecf2 expref: 45 pid: 5861 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.589202:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577607 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecf2 expref: 45 pid: 5861 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.589232:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:3.0:1788851092.589237:0:6721:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.589247:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.589256:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577631 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851092.589319:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851092.589413:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+44:2354:x1875746000804992:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 276us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851092.589422:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 65 00010000:00010000:0.0:1788851092.589614:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589624:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851092.589684:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788851092.589690:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788851092.589730:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589746:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589770:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589778:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577623 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589828:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589833:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851092.589838:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589846:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577623 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589856:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:0.0:1788851092.589859:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851092.589863:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577623 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589869:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577623 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589883:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a87957762a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589889:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a87957762a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589895:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a87957762a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589906:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851092.589909:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a87957762a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589915:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a87957762a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589934:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9ba0794000) 00010000:00010000:0.0:1788851092.589937:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851092.589940:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a87957762a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589947:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a87957762a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.589993:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a87957761c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecf9 expref: 44 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.590008:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecf9 expref: 43 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851092.590016:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:0.0:1788851092.590018:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851092.590020:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6600, rc 0) 00000100:00100000:0.0:1788851092.590056:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1df9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+43:11473:x1875746000804608:12345-192.168.204.6@tcp:101:stat.0 Request processed in 15999us (16440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851092.590064:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 155 00000100:00100000:0.0:1788851092.735564:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851092.735944:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000805248 00000100:00100000:2.0:1788851092.735957:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000805248 00000100:00100000:2.0:1788851092.736036:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 156 00000100:00100000:2.0:1788851092.736048:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+43:11479:x1875746000805248:12345-192.168.204.6@tcp:36:truncate.0 00010000:00010000:2.0:1788851092.736138:0:8079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851092.736176:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577631 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecf9 expref: 43 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.736204:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:2.0:1788851092.736210:0:8079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851092.736489:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577638 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.736505:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.736516:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851092.736580:0:8079:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788851092.736607:0:8079:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d604f43 reply state 00000000765014a3 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851092.736633:0:8079:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788851092.737424:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+45:11479:x1875746000805248:12345-192.168.204.6@tcp:36:truncate.0 Request processed in 1371us (1871us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788851092.737435:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 156 00000020:00080000:2.0:1788851092.737441:0:8079:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788851092.760639:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.760766:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577638 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.760774:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.760796:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851092.760802:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.760811:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577638 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.760884:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:2.0:1788851092.760888:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851092.760894:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577638 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.760902:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577638 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851092.952966:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851092.953658:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000805376 00000100:00100000:2.0:1788851092.953699:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000805376 00000100:00100000:2.0:1788851092.953864:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 157 00000100:00100000:2.0:1788851092.953879:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+44:11493:x1875746000805376:12345-192.168.204.6@tcp:101:stat.0 00010000:00010000:2.0:1788851092.953921:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851092.953950:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957763f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed00 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954042:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577646 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954072:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954087:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954103:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a87957764d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954110:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a87957764d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954116:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a87957764d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954405:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954415:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954423:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851092.954488:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788851092.954493:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788851092.954520:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954534:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954544:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954550:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577646 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954557:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577646 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954563:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851092.954568:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577646 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954578:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577646 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954592:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:2.0:1788851092.954596:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851092.954602:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577646 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954608:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577646 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954638:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a87957764d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954644:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a87957764d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954650:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a87957764d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954656:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851092.954659:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a87957764d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954665:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a87957764d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954673:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9bbcd02600) 00010000:00010000:2.0:1788851092.954675:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851092.954677:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a87957764d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954682:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a87957764d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954719:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957763f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed00 expref: 46 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954733:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed00 expref: 45 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851092.954752:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:2.0:1788851092.954754:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851092.954758:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547400, rc 0) 00000100:00100000:2.0:1788851092.954909:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+45:11493:x1875746000805376:12345-192.168.204.6@tcp:101:stat.0 Request processed in 1033us (1964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851092.954928:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 157 00000100:00100000:0.0:1788851093.108906:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851093.108999:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000805632 00000100:00100000:1.0:1788851093.109012:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000805632 00000100:00100000:1.0:1788851093.109108:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 158 00000100:00100000:1.0:1788851093.109121:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+45:11503:x1875746000805632:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851093.109147:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851093.109176:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a87957765b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed07 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851093.109492:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788851093.109669:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a87957765b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed07 expref: 47 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.109687:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b87c2ab00) 00010000:00010000:1.0:1788851093.109690:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788851093.109696:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a87957765b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed07 expref: 47 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.109715:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59600, rc 0) 00000100:00100000:1.0:1788851093.110010:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+46:11503:x1875746000805632:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 891us (1119us total) trans 4294967445 rc 301/301 00000100:00100000:1.0:1788851093.110019:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 158 00000100:00100000:3.0:1788851093.117589:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851093.120669:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000805888 00000100:00100000:2.0:1788851093.120691:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000805888 00000100:00100000:2.0:1788851093.120810:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:2.0:1788851093.120823:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b912ac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+46:11503:x1875746000805888:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1788851093.121175:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b912ac450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+47:11503:x1875746000805888:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 354us (3599us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788851093.121183:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 44 00010000:00010000:3.0:1788851093.268108:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851093.366428:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851093.366608:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000806144 00000100:00100000:2.0:1788851093.366621:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000806144 00000100:00100000:2.0:1788851093.366701:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 159 00000100:00100000:2.0:1788851093.366713:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+47:11509:x1875746000806144:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:2.0:1788851093.366741:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851093.366768:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577669 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed0e expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.366955:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.366973:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577654 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed00 expref: 48 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.367000:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.367045:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed00 expref: 48 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.367061:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577654 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed00 expref: 48 pid: 5861 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851093.367079:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafc93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875746019682816:192.168.204.6@tcp:104: 00000100:00100000:2.0:1788851093.367225:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9baefde900 going to sleep for 11 seconds 00000100:00100000:2.0:1788851093.378759:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafc93b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875746019682816:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851093.378860:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851093.381150:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851093.381622:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000806272 00000100:00100000:3.0:1788851093.381637:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000806272 00010000:00010000:3.0:1788851093.381696:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577654 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed00 expref: 49 pid: 5861 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851093.381749:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 66 00000100:00100000:3.0:1788851093.381761:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+49:2353:x1875746000806272:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851093.381813:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851093.381822:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577654 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed00 expref: 49 pid: 5861 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.381837:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed00 expref: 49 pid: 5861 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.381865:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547400/0x7ad3e1a879577654 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed00 expref: 49 pid: 5861 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.381885:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:3.0:1788851093.381891:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.381931:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.381939:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.381981:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851093.382058:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+48:2353:x1875746000806272:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 298us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851093.382066:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 66 00010000:00010000:2.0:1788851093.382165:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.382175:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851093.382199:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788851093.382397:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577669 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed0e expref: 49 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.382417:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed0e expref: 48 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.382437:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:2.0:1788851093.382440:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788851093.382442:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547200, rc 0) 00000100:00100000:2.0:1788851093.382480:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+48:11509:x1875746000806144:12345-192.168.204.6@tcp:101:bash.0 Request processed in 15770us (16067us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788851093.382487:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 159 00000100:00100000:0.0:1788851093.390219:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851093.390372:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000806528 00000100:00100000:2.0:1788851093.390385:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000806528 00000100:00100000:2.0:1788851093.390471:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 160 00000100:00100000:2.0:1788851093.390483:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+48:11509:x1875746000806528:12345-192.168.204.6@tcp:36:bash.0 00010000:00010000:2.0:1788851093.390881:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957767e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.390914:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957767e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.390930:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957767e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851093.391000:0:8079:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788851093.391029:0:8079:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0638963 reply state 000000003d3f39fa transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957767e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851093.391039:0:8079:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788851093.391163:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:11509:x1875746000806528:12345-192.168.204.6@tcp:36:bash.0 Request processed in 681us (970us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788851093.391170:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 160 00000020:00080000:2.0:1788851093.391192:0:8079:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788851093.402778:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957767e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.402819:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957767e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.402827:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957767e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.402834:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851093.402839:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957767e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.402848:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957767e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.402869:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:2.0:1788851093.402872:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851093.402877:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957767e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.402884:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957767e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851093.418942:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851093.419257:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000806656 00000100:00100000:3.0:1788851093.419271:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000806656 00000100:00100000:3.0:1788851093.419350:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 161 00000100:00100000:3.0:1788851093.419372:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+50:11509:x1875746000806656:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1788851093.419402:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851093.419429:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577685 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed15 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.419551:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957768c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.419567:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed0e expref: 51 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.419577:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957768c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.419617:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed0e expref: 51 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.419647:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed0e expref: 51 pid: 5861 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851093.419662:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019682944:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851093.419772:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b900 going to sleep for 11 seconds 00000100:00100000:3.0:1788851093.425711:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019682944:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851093.425754:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957768c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851093.426501:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851093.427301:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000806784 00000100:00100000:3.0:1788851093.427316:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000806784 00010000:00010000:3.0:1788851093.427382:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed0e expref: 52 pid: 5861 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851093.427435:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 67 00000100:00100000:3.0:1788851093.427447:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:2354:x1875746000806784:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851093.427465:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851093.427472:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed0e expref: 52 pid: 5861 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.427485:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed0e expref: 52 pid: 5861 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.427511:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547200/0x7ad3e1a879577670 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed0e expref: 52 pid: 5861 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.427553:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:3.0:1788851093.427559:0:6721:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957768c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.427569:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957768c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.427578:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957768c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851093.427619:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851093.427704:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:2354:x1875746000806784:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 259us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851093.427712:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 67 00010000:00010000:0.0:1788851093.428911:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957768c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851093.428928:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957768c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851093.428989:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788851093.428994:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788851093.429023:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957768c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851093.429091:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a879577685 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed15 expref: 51 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851093.429115:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957768c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed15 expref: 50 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851093.429125:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:0.0:1788851093.429128:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851093.429131:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4c00, rc 0) 00000100:00100000:0.0:1788851093.429350:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+50:11509:x1875746000806656:12345-192.168.204.6@tcp:101:bash.0 Request processed in 9835us (10278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851093.429362:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 161 00000100:00100000:0.0:1788851093.438380:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851093.438567:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000807040 00000100:00100000:2.0:1788851093.438581:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000807040 00000100:00100000:2.0:1788851093.438646:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00100000:2.0:1788851093.438656:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+50:11509:x1875746000807040:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:2.0:1788851093.438979:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:11509:x1875746000807040:12345-192.168.204.6@tcp:35:bash.0 Request processed in 323us (612us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788851093.439006:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00100000:3.0:1788851093.526453:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851093.526496:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851093.526539:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851093.526578:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851093.526695:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000807296 00000100:00100000:1.0:1788851093.526723:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000807296 00000100:00100000:1.0:1788851093.526833:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000807424 00000100:00100000:1.0:1788851093.526836:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000807424 00000100:00100000:1.0:1788851093.526867:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 82 00000100:00100000:1.0:1788851093.526880:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2352:x1875746000807296:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851093.526968:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2352:x1875746000807296:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 91us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851093.526976:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 82 00000100:00100000:1.0:1788851093.527006:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 83 00000100:00100000:1.0:1788851093.527015:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2352:x1875746000807424:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851093.527046:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2352:x1875746000807424:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 33us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851093.527052:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 83 00000100:00100000:1.0:1788851093.527078:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000807552 00000100:00100000:1.0:1788851093.527082:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000807552 00000100:00100000:1.0:1788851093.527111:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 164 00000100:00100000:1.0:1788851093.527119:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+5:2352:x1875746000807552:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851093.527148:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+5:2352:x1875746000807552:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 31us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851093.527155:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 164 00000100:00100000:0.0:1788851093.527246:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000807168 00000100:00100000:0.0:1788851093.527252:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000807168 00000100:00100000:0.0:1788851093.527294:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 300 00000100:00100000:0.0:1788851093.527302:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2352:x1875746000807168:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851093.527332:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2352:x1875746000807168:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 31us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851093.527341:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 300 00000100:00080000:3.0:1788851093.527847:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788851093.527853:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788851093.527855:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851093.591543:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851093.591660:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000807808 00000100:00100000:2.0:1788851093.591671:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000807808 00000100:00100000:2.0:1788851093.591733:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 162 00000100:00100000:2.0:1788851093.591744:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:11519:x1875746000807808:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1788851093.591774:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851093.591830:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed1c expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851093.591941:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788851093.592085:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577693 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed1c expref: 53 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.592102:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b87c2ab00) 00010000:00010000:2.0:1788851093.592105:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851093.592112:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed1c expref: 53 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.592126:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546a00, rc 0) 00000100:00100000:2.0:1788851093.592193:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:11519:x1875746000807808:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 451us (659us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788851093.592205:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 162 00000100:00100000:0.0:1788851093.596639:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851093.596989:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000807936 00000100:00100000:1.0:1788851093.597001:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000807936 00000100:00100000:1.0:1788851093.597060:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 163 00000100:00100000:1.0:1788851093.597072:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:11519:x1875746000807936:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:1.0:1788851093.597231:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795776a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597263:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795776a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597277:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795776a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597293:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795776a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597300:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795776a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597307:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795776a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597402:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a8795776af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597411:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a8795776af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597418:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a8795776af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851093.597536:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a8795776af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597550:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795776a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597556:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795776a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597573:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795776a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597580:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851093.597584:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795776a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597593:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795776a1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597618:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:1.0:1788851093.597621:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851093.597626:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795776a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597633:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795776a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597648:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795776a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597655:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795776a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597660:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795776a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597665:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851093.597669:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795776a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597755:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795776a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597849:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9b9199a600) 00010000:00010000:1.0:1788851093.597852:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851093.597855:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795776a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597861:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a8795776a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597877:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a8795776af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597884:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a8795776af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597890:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a8795776af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597896:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851093.597909:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a8795776af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597916:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a8795776af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597932:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:1.0:1788851093.597935:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851093.597939:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a8795776af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.597965:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a8795776af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851093.598104:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:11519:x1875746000807936:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 1031us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851093.598112:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 163 00000100:00100000:3.0:1788851093.602493:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851093.603463:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000808192 00000100:00100000:2.0:1788851093.603478:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000808192 00000100:00100000:2.0:1788851093.603610:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:2.0:1788851093.603622:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:11519:x1875746000808192:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1788851093.603984:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+53:11519:x1875746000808192:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 363us (1645us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788851093.603993:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:0.0:1788851093.656928:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851093.657072:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000808448 00000100:00100000:2.0:1788851093.657103:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000808448 00000100:00100000:2.0:1788851093.657179:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 164 00000100:00100000:2.0:1788851093.657191:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+53:11522:x1875746000808448:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1788851093.657222:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851093.657250:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795776b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed23 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657354:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a8795776bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657373:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a8795776bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657388:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a8795776bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657406:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657413:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657420:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657598:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a8795776cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657623:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a8795776cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657632:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a8795776cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851093.657645:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788851093.657767:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a8795776bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657775:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a8795776bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657836:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a8795776bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657844:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851093.657849:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a8795776bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657858:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a8795776bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657871:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:2.0:1788851093.657875:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851093.657880:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a8795776bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657886:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a8795776bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657912:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657928:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657935:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657941:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851093.657945:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657951:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657960:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9bbcd02600) 00010000:00010000:2.0:1788851093.657962:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851093.657965:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.657971:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.658028:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795776b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed23 expref: 56 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.658045:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a8795776cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed23 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.658053:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:2.0:1788851093.658056:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851093.658065:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547c00, rc 0) 00000100:00100000:2.0:1788851093.658151:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:11522:x1875746000808448:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 962us (1237us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788851093.658161:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 164 00000100:00100000:0.0:1788851093.663281:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851093.663340:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851093.663428:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000808576 00000100:00100000:2.0:1788851093.663443:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000808576 00000100:00100000:2.0:1788851093.663535:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 165 00000100:00100000:2.0:1788851093.663548:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:11522:x1875746000808576:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:2.0:1788851093.663641:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a8795776d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.663676:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a8795776d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.663692:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a8795776d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.663729:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a8795776d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.663737:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a8795776d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.663745:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a8795776d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.663751:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851093.663758:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a8795776d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.663766:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a8795776d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.663836:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:2.0:1788851093.663840:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851093.663846:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a8795776d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.663853:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a8795776d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851093.663966:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:11522:x1875746000808576:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 420us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851093.663974:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 165 00000100:00100000:1.0:1788851093.664418:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000808704 00000100:00100000:1.0:1788851093.664424:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000808704 00000100:00100000:1.0:1788851093.664472:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:1.0:1788851093.664479:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:2352:x1875746000808704:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851093.664492:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851093.664591:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a8795776cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed23 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851093.664607:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:1.0:1788851093.664611:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851093.664653:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:2352:x1875746000808704:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 174us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851093.664890:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:0.0:1788851093.668590:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851093.668769:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000808960 00000100:00100000:3.0:1788851093.668805:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000808960 00000100:00100000:3.0:1788851093.668871:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:3.0:1788851093.668885:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:11522:x1875746000808960:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1788851093.670606:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:11522:x1875746000808960:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 1714us (2018us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788851093.670642:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:3.0:1788851093.902217:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851093.902437:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000809216 00000100:00100000:2.0:1788851093.902466:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000809216 00000100:00100000:2.0:1788851093.902544:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 166 00000100:00100000:2.0:1788851093.902557:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:11540:x1875746000809216:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:2.0:1788851093.902589:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851093.902623:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a8795776e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed2a expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.903002:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795776e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.903021:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795776e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.903047:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795776e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851093.903070:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788851093.903248:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a8795776e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed2a expref: 58 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.904766:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795776e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed2a expref: 57 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.904778:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:2.0:1788851093.904843:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788851093.904846:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546a00, rc 0) 00000100:00100000:2.0:1788851093.905753:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:11540:x1875746000809216:12345-192.168.204.6@tcp:101:cat.0 Request processed in 3192us (3544us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788851093.905766:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 166 00000100:00100000:0.0:1788851093.968647:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851093.969573:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000809344 00000100:00100000:2.0:1788851093.969588:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000809344 00000100:00100000:2.0:1788851093.969669:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 167 00000100:00100000:2.0:1788851093.969679:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:11541:x1875746000809344:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1788851093.969708:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851093.969733:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a8795776f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed31 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.969870:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.969885:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.969909:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851093.969963:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788851093.969966:0:8079:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788851093.969986:0:8079:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.970017:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a8795776f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed31 expref: 59 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.971262:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed31 expref: 58 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851093.971280:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:2.0:1788851093.971283:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851093.971288:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546600, rc 0) 00000100:00100000:2.0:1788851093.971397:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+58:11541:x1875746000809344:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1719us (2762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851093.971407:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 167 00000100:00100000:0.0:1788851093.981269:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851093.981394:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000809728 00000100:00100000:2.0:1788851093.981407:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000809728 00000100:00100000:2.0:1788851093.981476:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:2.0:1788851093.981489:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+58:11541:x1875746000809728:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1788851093.981974:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+59:11541:x1875746000809728:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 476us (900us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788851093.981983:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:3.0:1788851093.987938:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851093.988994:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000809856 00000100:00100000:0.0:1788851093.989009:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000809856 00000100:00100000:0.0:1788851093.989102:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:0.0:1788851093.989113:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+59:11541:x1875746000809856:12345-192.168.204.6@tcp:103:lfs.0 00010000:00010000:0.0:1788851093.989131:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788851093.989158:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957768c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed15 expref: 59 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851093.989322:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a8795776e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed2a expref: 58 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851093.989532:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577597 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfecd6 expref: 57 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851093.989545:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2aa00) 00010000:00010000:0.0:1788851093.989560:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851093.989696:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:11541:x1875746000809856:12345-192.168.204.6@tcp:103:lfs.0 Request processed in 584us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851093.989704:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:0.0:1788851093.999889:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851094.000041:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000809984 00000100:00100000:3.0:1788851094.000056:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000809984 00000100:00100000:3.0:1788851094.001814:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 168 00000100:00100000:3.0:1788851094.001855:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:11541:x1875746000809984:12345-192.168.204.6@tcp:58:lfs.0 00010000:00010000:3.0:1788851094.002011:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577703 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.002048:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577703 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.002065:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577703 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851094.002590:0:5862:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788851094.002724:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:11541:x1875746000809984:12345-192.168.204.6@tcp:58:lfs.0 Request processed in 894us (2847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851094.002735:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 168 00000100:00080000:1.0:1788851094.003061:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851094.048757:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851094.048899:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000810112 00000100:00100000:2.0:1788851094.048914:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000810112 00000100:00100000:2.0:1788851094.049016:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 169 00000100:00100000:2.0:1788851094.049029:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:11543:x1875746000810112:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1788851094.049054:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851094.049221:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a87957770a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed38 expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049387:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577711 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049405:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577711 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049419:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577711 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049434:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577718 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049441:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049448:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049561:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957771f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049570:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957771f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049577:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957771f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851094.049636:0:5863:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788851094.049641:0:5863:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788851094.049665:0:5863:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957771f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049678:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957771f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049687:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577711 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049693:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577711 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049700:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577711 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049706:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851094.049711:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577711 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049718:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577711 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049731:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:2.0:1788851094.049734:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851094.049739:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577711 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049746:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577711 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.049775:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.050185:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577718 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.050192:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.050197:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851094.050201:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.050207:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577718 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.050217:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9bbcd02600) 00010000:00010000:2.0:1788851094.050220:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851094.050224:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577718 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.050230:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a879577718 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.050356:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a87957770a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed38 expref: 58 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.050374:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957771f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed38 expref: 57 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.050393:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:2.0:1788851094.050396:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851094.050399:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546a00, rc 0) 00000100:00100000:2.0:1788851094.050495:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:11543:x1875746000810112:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1468us (1753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851094.050504:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 169 00010000:00010000:2.0:1788851094.289998:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788851094.611628:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851094.611639:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851094.612252:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788851094.612263:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788851094.615111:0:11702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87ca1c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875746019683072:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788851094.615248:0:11702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc29540 going to sleep for 11 seconds 00000100:00100000:1.0:1788851094.625003:0:11702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87ca1c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875746019683072:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788851094.652482:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851094.652970:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000810240 00000100:00100000:3.0:1788851094.652982:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000810240 00000100:00100000:3.0:1788851094.653038:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 170 00000100:00100000:3.0:1788851094.653048:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:11554:x1875746000810240:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788851094.653084:0:5862:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788851094.653191:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:11554:x1875746000810240:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 144us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851094.653211:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 170 00000100:00100000:2.0:1788851094.667592:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851094.667635:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000810368 00000100:00100000:2.0:1788851094.667644:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000810368 00000100:00100000:2.0:1788851094.667696:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 171 00000100:00100000:2.0:1788851094.667719:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:11554:x1875746000810368:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788851094.667939:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577726 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.667959:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577726 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.667973:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577726 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668038:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957772d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668046:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957772d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668053:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957772d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668164:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577734 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668174:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668181:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851094.668222:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788851094.668227:0:8079:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788851094.668242:0:8079:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668253:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577726 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668261:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577726 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668268:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577726 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668276:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851094.668280:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577726 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668289:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577726 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668301:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a9bbcd02f00) 00010000:00010000:2.0:1788851094.668310:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851094.668317:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577726 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668324:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577726 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668344:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957772d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668351:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957772d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.668357:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957772d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.669153:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851094.669157:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957772d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.669166:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957772d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.669176:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8a9bbcd02600) 00010000:00010000:2.0:1788851094.669179:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851094.669183:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957772d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.669188:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957772d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.669205:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.669217:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577734 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.669223:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.669228:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851094.669231:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.669239:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577734 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.669247:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:2.0:1788851094.669249:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851094.669252:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577734 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.669258:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577734 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851094.669341:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:11554:x1875746000810368:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 Request processed in 1633us (1756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851094.669349:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 171 00000100:00100000:1.0:1788851094.673735:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851094.673936:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000810624 00000100:00100000:3.0:1788851094.673947:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000810624 00000100:00100000:3.0:1788851094.674010:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 172 00000100:00100000:3.0:1788851094.674020:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:11554:x1875746000810624:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851094.674044:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851094.674066:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a87957773b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed3f expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.674187:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.674205:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.674219:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851094.674232:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788851094.677232:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.677251:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577742 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.677260:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.677267:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851094.677272:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.677304:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577742 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.677322:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:3.0:1788851094.677325:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851094.677342:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577742 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.677349:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a879577742 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.677412:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a87957773b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed3f expref: 59 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.677424:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a9bbcd02f00) 00010000:00010000:3.0:1788851094.677427:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851094.677431:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a87957773b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed3f expref: 59 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.677443:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4a00, rc 0) 00000100:00100000:3.0:1788851094.679004:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+58:11554:x1875746000810624:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 4974us (5269us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788851094.679017:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 172 00000001:00080000:3.0:1788851094.680182:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967429 is committed 00000020:00080000:3.0:1788851094.680197:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a9b9864db40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788851094.680203:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9bbcfb0500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a9b9864d540 00000020:00080000:3.0:1788851094.680206:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9bbcfb0200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a9bab572000 00000001:00080000:3.0:1788851094.680247:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967445 is committed 00000004:00080000:3.0:1788851094.680262:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:3.0:1788851094.680287:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000100:00100000:3.0:1788851094.680612:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019683200:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788851094.680690:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851094.680826:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019683200 00000100:00100000:1.0:1788851094.680834:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019683200 00000100:00100000:1.0:1788851094.680907:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788851094.680919:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019683200:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788851094.680948:0:6707:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1788851094.680984:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9fb392, atime: 0x6a9fb393, ctime: 0x6a9fb392, blocks: 0xb 00010000:00010000:1.0:1788851094.680993:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018187a36/0x7ad3e1a879577750 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.681011:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1788851094.681016:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851094.681023:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018187a36/0x7ad3e1a879577750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.681042:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018187a36/0x7ad3e1a879577750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.681052:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018187a36/0x7ad3e1a879577750 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.681060:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018187a36/0x7ad3e1a879577750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.681092:0:6707:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788851094.681763:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875746019683200:12345-0@lo:6:osp-syn-0-0.0 Request processed in 845us (1071us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788851094.681772:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000020:00080000:2.0:1788851094.681915:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788851094.682026:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788851094.682044:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851094.682053:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018187a36/0x7ad3e1a879577750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.682075:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59a00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851094.682080:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018187a36/0x7ad3e1a879577750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.682090:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018187a36/0x7ad3e1a879577750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.682109:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018187a36/0x7ad3e1a879577750 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.682117:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018187a36/0x7ad3e1a879577750 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.682137:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851094.682139:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851094.682141:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788851094.682357:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851094.682392:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1788851094.682399:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1788851094.682420:0:3309:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a9b87d75f80 x1875746019683200/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788851110 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788851094.682432:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a9b87d75f80/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788851094.682438:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019683200:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788851094.686176:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851094.686349:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000810752 00000100:00100000:2.0:1788851094.686359:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000810752 00000100:00100000:2.0:1788851094.686423:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 173 00000100:00100000:2.0:1788851094.686434:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:11554:x1875746000810752:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788851094.686478:0:8079:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788851094.686592:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:11554:x1875746000810752:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 159us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851094.686600:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 173 00000100:00100000:2.0:1788851094.690534:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851094.690621:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000811008 00000100:00100000:1.0:1788851094.690631:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000811008 00000100:00100000:1.0:1788851094.690692:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 174 00000100:00100000:1.0:1788851094.690703:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:11554:x1875746000811008:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851094.690728:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851094.690731:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788851094.690761:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795776fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed31 expref: 17 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.690813:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:1.0:1788851094.690820:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851094.690836:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577757 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed46 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788851094.691773:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788851094.692696:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a87957775e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.692714:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a87957775e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.692727:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a87957775e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.693404:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577757 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed46 expref: 19 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.693427:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a87957775e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed46 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851094.693437:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a9b9199a700) 00010000:00010000:1.0:1788851094.693440:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851094.693444:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59e00, rc 0) 00000100:00100000:1.0:1788851094.693559:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:11554:x1875746000811008:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 2857us (3033us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788851094.693568:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 174 00000100:00100000:1.0:1788851094.700406:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851094.703738:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000811264 00000100:00100000:2.0:1788851094.703756:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000811264 00000100:00100000:2.0:1788851094.703846:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 175 00000100:00100000:2.0:1788851094.703857:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:11554:x1875746000811264:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788851094.703935:0:8079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851094.703966:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a87957775e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed46 expref: 18 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.703989:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a9b9199a700) 00010000:00010000:2.0:1788851094.704000:0:8079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851094.704035:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957776c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704051:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957776c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704063:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957776c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704308:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577773 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xbc089854 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704318:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc089854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704325:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc089854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704564:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957776c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704584:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957776c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704591:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957776c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704598:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851094.704603:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957776c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704611:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957776c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704620:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:2.0:1788851094.704623:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851094.704627:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957776c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704633:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957776c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704643:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc089854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704649:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577773 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc089854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704656:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577773 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc089854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704661:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851094.704670:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577773 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc089854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704677:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577773 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbc089854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704685:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xbc089854 (ffff8a9bbcd02600) 00010000:00010000:2.0:1788851094.704688:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851094.704691:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577773 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbc089854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851094.704697:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577773 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbc089854 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851094.704940:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:11554:x1875746000811264:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 1083us (4609us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788851094.704948:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 175 00000100:00100000:2.0:1788851094.721546:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851094.721638:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000811392 00000100:00100000:0.0:1788851094.721649:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000811392 00000100:00100000:0.0:1788851094.721710:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 176 00000100:00100000:0.0:1788851094.721721:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:11554:x1875746000811392:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851094.721745:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851094.721770:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957777a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed4d expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.721840:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577781 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.721856:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.721871:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.721996:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957777a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed4d expref: 19 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.722027:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577781 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed4d expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.722038:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:0.0:1788851094.722041:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788851094.722045:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7400, rc 0) 00000100:00100000:0.0:1788851094.722110:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:11554:x1875746000811392:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 391us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851094.722118:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 176 00000100:00100000:2.0:1788851094.729355:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851094.729469:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000811648 00000100:00100000:0.0:1788851094.729480:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000811648 00000100:00100000:0.0:1788851094.729541:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 177 00000100:00100000:0.0:1788851094.729551:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:11554:x1875746000811648:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788851094.729641:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577788 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.729659:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.729671:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851094.731001:0:8079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788851094.732985:0:8079:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 427674200223ns, next at 428674192515ns, rc = 0 00000004:00010000:0.0:1788851094.733143:0:8079:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000152d3e6a reply state 0000000026f09e0a transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851094.733156:0:8079:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788851094.733286:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+20:11554:x1875746000811648:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 3732us (3937us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788851094.733296:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 177 00010000:00010000:3.0:1788851094.747586:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577788 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.747604:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577788 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.747612:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577788 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.747619:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851094.747624:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577788 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.747632:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577788 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.747652:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:3.0:1788851094.747668:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788851094.747674:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577788 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.747681:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577788 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851094.753115:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851094.753378:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000811776 00000100:00100000:0.0:1788851094.753390:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000811776 00000100:00100000:0.0:1788851094.753445:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 178 00000100:00100000:0.0:1788851094.753456:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:11554:x1875746000811776:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851094.753485:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851094.753508:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957778f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed54 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.753586:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957778f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed54 expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.753604:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957778f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed54 expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.753624:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:0.0:1788851094.753627:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851094.753631:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6c00, rc 0) 00000100:00100000:0.0:1788851094.753690:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+20:11554:x1875746000811776:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 235us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851094.753697:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 178 00000100:00100000:0.0:1788851094.762079:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851094.762179:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000811904 00000100:00100000:3.0:1788851094.762189:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000811904 00000100:00100000:3.0:1788851094.762252:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:3.0:1788851094.762263:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000811904:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788851094.762646:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000811904:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 384us (574us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788851094.762654:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:1.0:1788851094.769538:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851094.769754:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000812160 00000100:00100000:2.0:1788851094.769765:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000812160 00000100:00100000:2.0:1788851094.769853:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:2.0:1788851094.769863:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+20:11554:x1875746000812160:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788851094.770126:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:11554:x1875746000812160:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 265us (597us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788851094.770134:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:2.0:1788851094.773417:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851094.773524:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000812416 00000100:00100000:3.0:1788851094.773535:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000812416 00000100:00100000:3.0:1788851094.773595:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 179 00000100:00100000:3.0:1788851094.773606:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:11554:x1875746000812416:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788851094.773718:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:11554:x1875746000812416:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 114us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851094.773725:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 179 00000100:00100000:2.0:1788851094.778655:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851094.778746:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000812544 00000100:00100000:3.0:1788851094.778756:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000812544 00000100:00100000:3.0:1788851094.778841:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 180 00000100:00100000:3.0:1788851094.778852:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:11554:x1875746000812544:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851094.778887:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851094.778912:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577796 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed5b expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.779001:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a87957779d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.779017:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a87957779d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.779043:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a87957779d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851094.779091:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788851094.779111:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a87957779d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.779140:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577796 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed5b expref: 23 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.779162:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a87957779d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed5b expref: 22 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.779172:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:3.0:1788851094.779175:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788851094.779180:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a5c00, rc 0) 00000100:00100000:3.0:1788851094.779242:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:11554:x1875746000812544:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 391us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851094.779249:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 180 00000100:00100000:1.0:1788851094.786720:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851094.786821:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000812672 00000100:00100000:3.0:1788851094.786831:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000812672 00000100:00100000:3.0:1788851094.786900:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:3.0:1788851094.786925:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2354:x1875746000812672:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851094.786948:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851094.786971:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed62 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851094.787000:0:6707:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fb396, blocks: 0x1 00010000:00010000:3.0:1788851094.787034:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1788851094.787040:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851094.787049:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed62 expref: 8 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.787069:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed62 expref: 8 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.787083:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4c00, rc 0) 00000100:00100000:3.0:1788851094.787144:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2354:x1875746000812672:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 221us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851094.787151:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:3.0:1788851094.789965:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851094.790059:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000812928 00000100:00100000:0.0:1788851094.790069:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000812928 00000100:00100000:0.0:1788851094.790128:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 181 00000100:00100000:0.0:1788851094.790138:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:11554:x1875746000812928:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788851094.790251:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:11554:x1875746000812928:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 114us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851094.790259:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 181 00000100:00100000:2.0:1788851094.797421:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851094.797536:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000813056 00000100:00100000:3.0:1788851094.797547:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000813056 00000100:00100000:3.0:1788851094.797609:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:3.0:1788851094.797620:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:11554:x1875746000813056:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851094.797642:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851094.797665:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000510a9c06/0x7ad3e1a8795777ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed69 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.797721:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed62 expref: 9 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.797731:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851094.797735:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851094.797741:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000510a9c06/0x7ad3e1a8795777ab lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed69 expref: 9 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.797807:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed62 expref: 9 pid: 6707 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.797821:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed62 expref: 9 pid: 6707 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851094.797836:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4133100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1875746019683328:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851094.797937:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851094.810297:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851094.812289:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000813184 00000100:00100000:0.0:1788851094.812303:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000813184 00010000:00010000:0.0:1788851094.812355:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777a4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed62 expref: 10 pid: 6707 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851094.812396:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:0.0:1788851094.812406:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b906b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+10:2353:x1875746000813184:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851094.812421:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851094.812445:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777a4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed62 expref: 10 pid: 6707 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.812460:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed62 expref: 10 pid: 6707 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.812485:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851094.812490:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851094.812499:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000510a9c06/0x7ad3e1a8795777ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed69 expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.812527:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000510a9c06/0x7ad3e1a8795777ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed69 expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851094.812567:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000510a9c06/0x7ad3e1a8795777ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed69 expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851094.812583:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ffb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5848:1875746019683456:192.168.204.6@tcp:105: 00000100:00100000:0.0:1788851094.812669:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b9864dc00 going to sleep for 11 seconds 00010000:00010000:3.0:1788851094.820094:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed62 expref: 10 pid: 6707 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851094.820119:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4133100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1875746019683328:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851094.820152:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000510a9c06/0x7ad3e1a8795777ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed69 expref: 9 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851094.820169:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4600, rc 0) 00000100:00100000:3.0:1788851094.820252:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:11554:x1875746000813056:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 22632us (22841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851094.820261:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:2.0:1788851094.821962:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ffb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5848:1875746019683456:192.168.204.6@tcp:105: 00010000:00010000:2.0:1788851094.821989:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851094.822058:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b906b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2353:x1875746000813184:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 9653us (11782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851094.822069:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:3.0:1788851094.830672:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851094.830740:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000813312 00000100:00100000:2.0:1788851094.830750:0:6712:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000813312 00002000:00100000:2.0:1788851094.830832:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8a9bb4133100 x1875746000813312/t0(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:160/0 lens 504/0 e 0 to 0 dl 1788851105 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788851094.830844:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bb4133100 with x1875746000813312 ext(0->8) 00002000:00010000:2.0:1788851094.830850:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bb4133100 00000100:00100000:2.0:1788851094.830889:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:2.0:1788851094.830901:0:6712:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2354:x1875746000813312:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788851094.831412:0:6712:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+10:2354:x1875746000813312:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 Request processed in 511us (749us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788851094.831421:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 4 00002000:00100000:2.0:1788851094.831428:0:6712:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8a9bb4133100 x1875746000813312/t4294967314(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:160/0 lens 504/448 e 0 to 0 dl 1788851105 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788851094.831437:0:6712:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bb4133100 with x1875746000813312 ext(0->8) 00002000:00010000:2.0:1788851094.831440:0:6712:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bb4133100 00000100:00100000:3.0:1788851094.836835:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851094.836938:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000813440 00000100:00100000:2.0:1788851094.836948:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000813440 00000100:00100000:2.0:1788851094.837002:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 182 00000100:00100000:2.0:1788851094.837021:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:11554:x1875746000813440:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788851094.979492:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4130380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:11554:x1875746000813440:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 Request processed in 142467us (142654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851094.979507:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 182 00000001:00080000:3.0:1788851094.979554:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1788851094.979563:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:3.0:1788851094.979590:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1788851094.979597:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1788851094.979746:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1788851094.979760:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788851094.979775:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019683584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788851094.979867:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851094.979956:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019683584 00000100:00100000:3.0:1788851094.979964:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019683584 00000100:00100000:3.0:1788851094.980018:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788851094.980028:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019683584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788851094.980227:0:6707:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00000100:00080000:2.0:1788851094.981557:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1788851094.986902:0:6707:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788851094 00002000:00010000:3.0:1788851094.986909:0:6707:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788851094.986911:0:6707:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788851094 -> 1788851094 00002000:00010000:3.0:1788851094.986914:0:6707:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788851094.987013:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875746019683584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 6982us (7141us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788851094.987042:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788851094.987524:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851094.987699:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000813568 00000100:00100000:0.0:1788851094.987708:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000813568 00000100:00100000:0.0:1788851094.987765:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:0.0:1788851094.987776:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+10:2351:x1875746000813568:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1788851094.989748:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a9bc1a5b480/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788851094.989763:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019683584:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1788851095.080341:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:1.0:1788851095.080374:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:2.0:1788851095.087826:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2351:x1875746000813568:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 Request processed in 100038us (100291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851095.087844:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:2.0:1788851095.100716:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851095.101059:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000813824 00000100:00100000:0.0:1788851095.101072:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000813824 00000100:00100000:0.0:1788851095.101136:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 183 00000100:00100000:0.0:1788851095.101147:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:11554:x1875746000813824:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788851095.101205:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851095.101246:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a87957779d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed5b expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.101275:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:0.0:1788851095.101281:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851095.101329:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795777b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.101366:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795777b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.101378:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795777b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851095.101675:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9810c58 reply state 00000000fd967bb5 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795777b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851095.101685:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788851095.101834:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:11554:x1875746000813824:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 689us (1129us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788851095.101843:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 183 00010000:00010000:2.0:1788851095.107209:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795777b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.107240:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795777b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.107249:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795777b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.107256:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851095.107262:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795777b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.107270:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795777b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.107290:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:2.0:1788851095.107294:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851095.107300:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795777b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.107307:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795777b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851095.108577:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851095.108671:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000813952 00000100:00100000:1.0:1788851095.108681:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000813952 00000100:00100000:1.0:1788851095.108762:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:1.0:1788851095.108773:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2354:x1875746000813952:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788851095.109089:0:8281:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788851095.109093:0:8281:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788851094 -> 1788851093 00002000:00010000:1.0:1788851095.109112:0:8281:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788851091 00002000:00010000:1.0:1788851095.109114:0:8281:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788851094 -> 1788851093 00002000:00010000:1.0:1788851095.109123:0:8281:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788851095.109185:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2354:x1875746000813952:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 413us (616us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788851095.109194:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00080000:2.0:1788851095.109975:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788851095.145900:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851095.146019:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000814208 00000100:00100000:3.0:1788851095.146031:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000814208 00000100:00100000:3.0:1788851095.146114:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 184 00000100:00100000:3.0:1788851095.146124:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:11554:x1875746000814208:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788851095.146203:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.146222:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577781 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed4d expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.146431:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777b9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.146473:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577781 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed4d expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.146489:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577781 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed4d expref: 18 pid: 5862 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851095.146505:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a59180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875746019683712:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851095.146601:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851095.154690:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851095.154754:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000814336 00000100:00100000:0.0:1788851095.154765:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000814336 00010000:00010000:0.0:1788851095.154836:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577781 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed4d expref: 19 pid: 5862 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851095.154892:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:0.0:1788851095.154903:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:2354:x1875746000814336:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851095.154918:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851095.154926:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577781 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed4d expref: 19 pid: 5862 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.154940:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577781 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed4d expref: 19 pid: 5862 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.154984:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:0.0:1788851095.154989:0:6721:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.155000:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.155008:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777b9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.155030:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851095.155094:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:2354:x1875746000814336:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 193us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851095.155102:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 69 00010000:00010000:3.0:1788851095.155551:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577781 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed4d expref: 18 pid: 5862 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851095.155581:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a59180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875746019683712:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851095.155603:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.155613:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.155619:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.155648:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.155655:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.155662:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.155669:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851095.155673:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.155681:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.155691:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:3.0:1788851095.155694:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788851095.155697:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.155710:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851095.155769:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:11554:x1875746000814208:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 Request processed in 9646us (9881us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788851095.155804:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 184 00000100:00100000:2.0:1788851095.188837:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851095.188931:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000814464 00000100:00100000:3.0:1788851095.188941:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000814464 00000100:00100000:3.0:1788851095.188999:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:3.0:1788851095.189011:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2352:x1875746000814464:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788851095.189080:0:6707:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777c0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.189114:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000510a9c06/0x7ad3e1a8795777ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed69 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.189124:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788851095.189129:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851095.189134:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777c0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.189174:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000510a9c06/0x7ad3e1a8795777ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed69 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.189189:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000510a9c06/0x7ad3e1a8795777ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed69 expref: 8 pid: 6704 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851095.189224:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6707:1875746019683840:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851095.189332:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851095.200002:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851095.200932:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6707:1875746019683840:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851095.200964:0:6707:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777c0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851095.201445:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000814592 00000100:00100000:1.0:1788851095.201454:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000814592 00010000:00010000:1.0:1788851095.201498:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000510a9c06/0x7ad3e1a8795777ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed69 expref: 9 pid: 6704 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851095.201540:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00100000:1.0:1788851095.201551:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:2354:x1875746000814592:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851095.201569:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851095.201596:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000510a9c06/0x7ad3e1a8795777ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed69 expref: 9 pid: 6704 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.201610:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000510a9c06/0x7ad3e1a8795777ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed69 expref: 9 pid: 6704 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.201639:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000510a9c06/0x7ad3e1a8795777ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed69 expref: 9 pid: 6704 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.201656:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788851095.201660:0:5847:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788851095.201665:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.201674:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777c0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.201723:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851095.201805:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2354:x1875746000814592:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 255us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.201813:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 70 00010000:00010000:3.0:1788851095.206864:0:6707:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.206898:0:6707:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.206939:0:6707:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777c0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.206948:0:6707:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.206958:0:6707:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.206966:0:6707:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851095.206970:0:6707:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.207000:0:6707:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.207022:0:6707:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.207031:0:6707:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002686caa6/0x7ad3e1a8795777c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851095.207147:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2352:x1875746000814464:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 Request processed in 18133us (18315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851095.207158:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:2.0:1788851095.215261:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851095.215397:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000814848 00000100:00100000:3.0:1788851095.215409:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000814848 00000100:00100000:3.0:1788851095.215476:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 185 00000100:00100000:3.0:1788851095.215488:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+17:11554:x1875746000814848:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788851095.215576:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.215595:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.215608:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.215855:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a8795777ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.215886:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957778f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed54 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.215896:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a8795777ce lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.215933:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957778f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed54 expref: 18 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.215949:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957778f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed54 expref: 18 pid: 5862 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851095.215965:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a59180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019683968:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851095.216056:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851095.237690:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851095.238183:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a59180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019683968:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851095.238265:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a8795777ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851095.238606:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000814976 00000100:00100000:1.0:1788851095.238614:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000814976 00010000:00010000:1.0:1788851095.238655:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957778f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed54 expref: 19 pid: 5862 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851095.238689:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 71 00000100:00100000:1.0:1788851095.238698:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:2353:x1875746000814976:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851095.238714:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851095.238721:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957778f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed54 expref: 19 pid: 5862 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.238733:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957778f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed54 expref: 19 pid: 5862 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.238757:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957778f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed54 expref: 19 pid: 5862 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.238773:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:1.0:1788851095.238813:0:6721:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a8795777ce lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.238823:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a8795777ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.238847:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a8795777ce lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.238885:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851095.238940:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:2353:x1875746000814976:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 242us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.238948:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 71 00010000:00010000:0.0:1788851095.239191:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a8795777ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.239200:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a8795777ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788851095.239429:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788851095.239585:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788851095.239631:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788851095.239716:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5863:1875746019684096:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788851095.239771:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851095.239826:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b953d2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788851095.243495:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019684096 00000100:00100000:2.0:1788851095.243510:0:5867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019684096 00000100:00100000:2.0:1788851095.243587:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788851095.243598:0:5867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5863:x1875746019684096:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788851095.243748:0:5867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5863:x1875746019684096:12345-0@lo:1000:mdt00_002.0 Request processed in 152us (3976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851095.243756:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788851095.244035:0:5863:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788851095.244042:0:5863:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a9bc1a5b480, transno 4294967315 00000100:00100000:3.0:1788851095.244066:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5863:1875746019684096:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788851095.244620:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788851095.244708:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a59180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5863:1875746019684224:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788851095.244757:0:5863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851095.245983:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851095.246445:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019684224 00000100:00100000:1.0:1788851095.246454:0:5867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019684224 00000100:00100000:1.0:1788851095.246519:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788851095.246528:0:5867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5863:x1875746019684224:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788851095.246758:0:5867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5863:x1875746019684224:12345-0@lo:1000:mdt00_002.0 Request processed in 230us (1999us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788851095.246765:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788851095.246854:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a59180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5863:1875746019684224:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788851095.246909:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a8795777ce lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.246929:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a8795777ce lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.246938:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a8795777ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.246945:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851095.246950:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a8795777ce lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.246959:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a8795777ce lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.246977:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:0.0:1788851095.246980:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851095.246985:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a8795777ce lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.246991:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a8795777ce lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.247023:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577703 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.247029:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577703 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.247035:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577703 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.247040:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851095.247048:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577703 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.247054:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577703 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.247063:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:0.0:1788851095.247065:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851095.247068:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577703 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.247073:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577703 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.247094:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795777d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.247109:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957771f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed38 expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.247118:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795777d5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.247148:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957771f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed38 expref: 21 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.247162:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957771f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed38 expref: 21 pid: 5863 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851095.247176:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ff9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019684352:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851095.247247:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87d6de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851095.251963:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ff9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019684352:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851095.251993:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795777d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851095.282083:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851095.282368:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000815104 00000100:00100000:0.0:1788851095.282380:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000815104 00010000:00010000:0.0:1788851095.282426:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957771f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed38 expref: 22 pid: 5863 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851095.282469:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 72 00000100:00100000:0.0:1788851095.282481:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:2354:x1875746000815104:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851095.282499:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851095.282507:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957771f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed38 expref: 22 pid: 5863 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.282520:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957771f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed38 expref: 22 pid: 5863 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.282543:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a87957771f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed38 expref: 22 pid: 5863 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.282561:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:0.0:1788851095.282568:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795777d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.282579:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795777d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.282587:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795777d5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.282620:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851095.282677:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:2354:x1875746000815104:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 198us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851095.282697:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 72 00010000:00010000:1.0:1788851095.293414:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795777d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.293434:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795777d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.293451:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795777d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.293458:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795777d5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.293478:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795777d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.293484:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851095.293489:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795777d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.293497:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795777d5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.293515:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:1.0:1788851095.293519:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851095.293524:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795777d5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.293531:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795777d5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.293545:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.293551:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.293556:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.293559:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851095.293562:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.293576:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.293583:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2a900) 00010000:00010000:1.0:1788851095.293585:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788851095.293588:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.293593:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851095.294570:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+20:11554:x1875746000814848:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 79073us (79308us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1788851095.294584:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 185 00000020:00080000:1.0:1788851095.294591:0:5863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788851095.295954:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788851095.295963:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788851095.296471:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788851095.296481:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788851095.300002:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851095.300067:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000815360 00000100:00100000:2.0:1788851095.300086:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000815360 00000100:00100000:2.0:1788851095.300150:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:2.0:1788851095.300161:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b912ae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+20:11554:x1875746000815360:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788851095.300913:0:5865:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788851095.301021:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788851095.301088:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795777dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.301107:0:5865:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795777dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.301120:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795777dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.301130:0:5865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795777dc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.301145:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795777dc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.301150:0:5865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795777dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.301177:0:5865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788851095.301279:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b912ae850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:11554:x1875746000815360:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 1118us (1286us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788851095.301288:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 50 00000020:00080000:2.0:1788851095.301294:0:5865:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788851095.301830:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851095.301840:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795777dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.301847:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546600 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851095.301852:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795777dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.301860:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795777dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.301884:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8a9bbcd02c00) 00010000:00010000:3.0:1788851095.301887:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788851095.301893:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795777dc lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.301900:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a8795777dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.301921:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851095.301923:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851095.301924:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851095.318584:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851095.461375:0:12533:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788851095.461385:0:12533:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788851095.461432:0:12533:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788851095.461439:0:12533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788851095.725180:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851095.729241:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000815616 00000100:00100000:0.0:1788851095.729261:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000815616 00000100:00100000:0.0:1788851095.729382:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 186 00000100:00100000:0.0:1788851095.729398:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:11565:x1875746000815616:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1788851095.729436:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851095.729459:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795777e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed70 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.729581:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795777ea lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.729596:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795777ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.729609:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795777ea lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851095.729631:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788851095.729764:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795777e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed70 expref: 25 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.729838:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795777ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed70 expref: 24 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851095.729848:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:0.0:1788851095.729852:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788851095.729867:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7e00, rc 0) 00000100:00100000:0.0:1788851095.729945:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+24:11565:x1875746000815616:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 552us (4776us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788851095.729951:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 186 00000100:00100000:1.0:1788851095.746481:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851095.752236:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000815744 00000100:00100000:3.0:1788851095.752253:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000815744 00000100:00100000:3.0:1788851095.753233:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 187 00000100:00100000:3.0:1788851095.753252:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+24:11565:x1875746000815744:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:3.0:1788851095.753356:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753378:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753401:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753419:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753427:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753433:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753689:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577806 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753698:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753706:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851095.753747:0:8079:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753760:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753766:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753773:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753817:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851095.753821:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753829:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753840:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:3.0:1788851095.753844:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851095.753849:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753855:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795777f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753877:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753883:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753888:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753893:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851095.753895:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753902:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753919:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9b87c2ac00) 00010000:00010000:3.0:1788851095.753921:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851095.753924:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753929:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795777ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753944:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753949:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577806 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753953:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753957:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851095.753960:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753964:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577806 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753970:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2a700) 00010000:00010000:3.0:1788851095.753971:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851095.753974:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577806 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.753978:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577806 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851095.754094:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+24:11565:x1875746000815744:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 848us (7622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851095.754103:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 187 00000100:00100000:1.0:1788851095.833372:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851095.835129:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000816000 00000100:00100000:3.0:1788851095.835144:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000816000 00000100:00100000:3.0:1788851095.835209:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 188 00000100:00100000:3.0:1788851095.835220:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+24:11568:x1875746000816000:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:3.0:1788851095.835247:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851095.835270:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a87957780d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed77 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.836808:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577814 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.836834:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.836847:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.836878:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957781b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.836887:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957781b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.836894:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957781b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.840803:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577822 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.840827:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.840842:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851095.840871:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788851095.841007:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577814 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841015:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577814 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841022:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841029:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851095.841034:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841041:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577814 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841056:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:3.0:1788851095.841059:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851095.841065:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577814 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841081:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841097:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957781b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841104:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957781b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841110:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957781b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841114:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851095.841117:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957781b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841123:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957781b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841130:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9b87c2a700) 00010000:00010000:3.0:1788851095.841133:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851095.841136:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957781b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841141:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a87957781b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841198:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a87957780d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed77 expref: 27 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841214:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed77 expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.841227:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2ac00) 00010000:00010000:3.0:1788851095.841229:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851095.841232:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4a00, rc 0) 00000100:00100000:3.0:1788851095.841314:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:11568:x1875746000816000:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 6095us (7950us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788851095.841323:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 188 00000100:00100000:3.0:1788851095.848564:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851095.849011:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000816128 00000100:00100000:1.0:1788851095.849023:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000816128 00000100:00100000:1.0:1788851095.849178:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 189 00000100:00100000:1.0:1788851095.849190:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:11568:x1875746000816128:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:1.0:1788851095.849264:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577830 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.849283:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.849296:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.849331:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577830 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.849338:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577830 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.849344:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.849350:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851095.849355:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577830 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.849363:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577830 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.849375:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2ac00) 00010000:00010000:1.0:1788851095.849378:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788851095.849383:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577830 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.849389:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577830 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851095.849457:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:11568:x1875746000816128:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 269us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.849465:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 189 00000100:00100000:3.0:1788851095.852068:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851095.852111:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000816384 00000100:00100000:3.0:1788851095.852120:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000816384 00000100:00100000:3.0:1788851095.852167:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:3.0:1788851095.852177:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:11568:x1875746000816384:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1788851095.852406:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+27:11568:x1875746000816384:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 230us (345us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788851095.852414:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:1.0:1788851095.939070:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851095.939141:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000816640 00000100:00100000:2.0:1788851095.939152:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000816640 00000100:00100000:2.0:1788851095.939220:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 190 00000100:00100000:2.0:1788851095.939230:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+27:11102:x1875746000816640:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:2.0:1788851095.939262:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851095.939288:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577837 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed7e expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.939405:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.939422:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577822 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed77 expref: 28 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.939433:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.939494:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed77 expref: 28 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851095.939509:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed77 expref: 28 pid: 5862 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851095.939522:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3c1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875746019684480:192.168.204.6@tcp:104: 00000100:00100000:2.0:1788851095.939631:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafdae600 going to sleep for 11 seconds 00000100:00100000:3.0:1788851095.955089:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851095.955683:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000816768 00000100:00100000:1.0:1788851095.955693:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000816768 00010000:00010000:1.0:1788851095.955756:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577822 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed77 expref: 29 pid: 5862 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851095.955851:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00100000:1.0:1788851095.955871:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+29:2353:x1875746000816768:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851095.955889:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851095.955905:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577822 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed77 expref: 29 pid: 5862 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.955920:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed77 expref: 29 pid: 5862 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.955953:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2ac00) 00010000:00010000:1.0:1788851095.955969:0:6721:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.955980:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.955988:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.956011:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851095.956065:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+29:2353:x1875746000816768:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 197us (986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.956072:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 73 00010000:00010000:2.0:1788851095.960328:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577822 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed77 expref: 28 pid: 5862 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851095.960359:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3c1d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875746019684480:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851095.960386:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.964972:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.964991:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851095.965021:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788851095.965704:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577837 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed7e expref: 29 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.965901:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed7e expref: 28 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851095.965912:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2ac00) 00010000:00010000:3.0:1788851095.965915:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788851095.965919:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546600, rc 0) 00000100:00100000:3.0:1788851095.966039:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+28:11102:x1875746000816640:12345-192.168.204.6@tcp:101:bash.0 Request processed in 26809us (26979us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788851095.966049:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 190 00000100:00100000:3.0:1788851095.977819:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851095.977949:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000817024 00000100:00100000:1.0:1788851095.978120:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000817024 00000100:00100000:1.0:1788851095.978190:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 191 00000100:00100000:1.0:1788851095.978210:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+28:11102:x1875746000817024:12345-192.168.204.6@tcp:36:bash.0 00010000:00010000:1.0:1788851095.978513:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a87957784c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.978532:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a87957784c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.978546:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a87957784c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788851095.978601:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1788851095.978627:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf7e03fd reply state 0000000026d8583d transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a87957784c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851095.978636:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788851095.978684:0:5863:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1788851095.979309:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+32:11102:x1875746000817024:12345-192.168.204.6@tcp:36:bash.0 Request processed in 1097us (1534us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788851095.979318:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 191 00000020:00080000:1.0:1788851095.979324:0:5863:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788851095.985197:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a87957784c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.985216:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a87957784c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.985224:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a87957784c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.985231:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851095.985236:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a87957784c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.985260:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a87957784c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.985283:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2ac00) 00010000:00010000:1.0:1788851095.985286:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851095.985292:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a87957784c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.985298:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a87957784c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851095.989404:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851095.995875:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000817152 00000100:00100000:0.0:1788851095.995892:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000817152 00000100:00100000:1.0:1788851095.996211:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 192 00000100:00100000:1.0:1788851095.996222:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+31:11102:x1875746000817152:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1788851095.996917:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851095.996946:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879577853 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed85 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.997144:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879577853 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed85 expref: 32 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.997166:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879577853 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed85 expref: 32 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851095.997190:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2ac00) 00010000:00010000:1.0:1788851095.997193:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788851095.997197:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59e00, rc 0) 00000100:00100000:1.0:1788851095.997329:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+32:11102:x1875746000817152:12345-192.168.204.6@tcp:101:bash.0 Request processed in 1107us (7933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851095.997367:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 192 00000100:00100000:3.0:1788851096.003215:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851096.003414:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000817280 00000100:00100000:1.0:1788851096.003424:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000817280 00000100:00100000:1.0:1788851096.003510:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:1.0:1788851096.003533:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:11102:x1875746000817280:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1788851096.003555:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851096.003579:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018187a36/0x7ad3e1a87957785a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed8c expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851096.003611:0:8281:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9fb395, atime: 0x6a9fb393, ctime: 0x6a9fb395, blocks: 0xb 00010000:00010000:1.0:1788851096.003637:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=428s v=(0 0) 00010000:00010000:1.0:1788851096.003642:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851096.003663:0:8281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018187a36/0x7ad3e1a87957785a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed8c expref: 8 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.003681:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018187a36/0x7ad3e1a87957785a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed8c expref: 8 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.003696:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59a00, rc 0) 00000100:00100000:1.0:1788851096.003768:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:11102:x1875746000817280:12345-192.168.204.6@tcp:101:bash.0 Request processed in 249us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851096.003775:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:0.0:1788851096.006940:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851096.007243:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000817408 00000100:00100000:1.0:1788851096.007254:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000817408 00002000:00010000:1.0:1788851096.007303:0:6711:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788851096.007308:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bc1ff8380 with x1875746000817408 ext(0->18446744073709551615) 00002000:00010000:1.0:1788851096.007337:0:6711:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bc1ff8380. 00000100:00100000:1.0:1788851096.007494:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:1.0:1788851096.007506:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2354:x1875746000817408:12345-192.168.204.6@tcp:10:bash.0 00002000:00010000:1.0:1788851096.007908:0:6711:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788851096.007912:0:6711:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788851093 -> 1788851095 00002000:00010000:1.0:1788851096.007915:0:6711:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788851091 -> 1788851091 00002000:00010000:1.0:1788851096.007918:0:6711:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788851093 -> 1788851095 00002000:00010000:1.0:1788851096.007920:0:6711:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788851096.007988:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:2354:x1875746000817408:12345-192.168.204.6@tcp:10:bash.0 Request processed in 484us (1058us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788851096.007997:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 5 00002000:00010000:1.0:1788851096.008001:0:6711:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788851096.008004:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bc1ff8380 with x1875746000817408 ext(0->18446744073709551615) 00002000:00010000:1.0:1788851096.008009:0:6711:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bc1ff8380. 00000100:00100000:2.0:1788851096.135947:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851096.136045:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000817536 00000100:00100000:3.0:1788851096.136056:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000817536 00000100:00100000:3.0:1788851096.136141:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 193 00000100:00100000:3.0:1788851096.136153:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+32:11582:x1875746000817536:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:3.0:1788851096.136238:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577861 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.136258:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577861 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.136275:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577861 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.136296:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577868 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.136463:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.136472:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.136736:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957786f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137089:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957786f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137098:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957786f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851096.137144:0:8079:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957786f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137156:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577861 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137163:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577861 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137171:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577861 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137179:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851096.137184:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577861 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137192:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577861 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137214:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:3.0:1788851096.137217:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851096.137224:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577861 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137230:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577861 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137245:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577868 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137251:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577868 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137255:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137260:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851096.137263:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577868 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137268:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577868 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137275:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9b87c2a700) 00010000:00010000:3.0:1788851096.137277:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851096.137280:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577868 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137286:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577868 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788851096.137457:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788851096.137499:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957786f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137507:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957786f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137513:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957786f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137519:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851096.137522:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957786f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137529:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957786f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137537:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2ac00) 00010000:00010000:3.0:1788851096.137540:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851096.137543:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957786f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.137549:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957786f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851096.137684:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+32:11582:x1875746000817536:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 1531us (1746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851096.137694:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 193 00000100:00100000:3.0:1788851096.228957:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851096.229163:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000817792 00000100:00100000:2.0:1788851096.229173:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000817792 00000100:00100000:2.0:1788851096.229245:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 194 00000100:00100000:2.0:1788851096.229258:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+32:11585:x1875746000817792:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1788851096.229283:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851096.229317:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577876 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed93 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.229408:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957787d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.229442:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957787d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.229456:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957787d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.229482:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577884 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.229490:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.229498:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.230085:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957788b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.230097:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957788b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.230106:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957788b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851096.230116:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788851096.230218:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957787d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.230227:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957787d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.230234:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957787d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.230247:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851096.230252:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957787d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.230261:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957787d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.230275:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:2.0:1788851096.230278:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851096.230749:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957787d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.230760:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547c00/0x7ad3e1a87957787d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.230945:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.230951:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577884 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.230958:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577884 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.230963:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851096.230966:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577884 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.230972:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577884 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.230997:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9bbcd02300) 00010000:00010000:2.0:1788851096.231000:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851096.231003:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577884 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.231009:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546000/0x7ad3e1a879577884 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.231063:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577876 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed93 expref: 35 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.231079:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957788b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed93 expref: 34 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.231086:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2ac00) 00010000:00010000:2.0:1788851096.231088:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788851096.231090:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546800, rc 0) 00000100:00100000:2.0:1788851096.231178:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:11585:x1875746000817792:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1922us (2232us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788851096.231187:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 194 00000100:00100000:0.0:1788851096.244461:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851096.244824:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000817920 00000100:00100000:1.0:1788851096.244834:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000817920 00000100:00100000:1.0:1788851096.244947:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 195 00000100:00100000:1.0:1788851096.244959:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:11585:x1875746000817920:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:1.0:1788851096.245061:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577899 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.245081:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed7e expref: 34 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.245092:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577899 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.245157:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed7e expref: 34 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.245173:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed7e expref: 34 pid: 5861 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851096.245191:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf0b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019684608:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851096.245294:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc29f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788851096.261643:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851096.261889:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf0b0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019684608:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851096.261918:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577899 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851096.263712:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000818176 00000100:00100000:2.0:1788851096.263728:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000818176 00000100:00100000:2.0:1788851096.263892:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:2.0:1788851096.263903:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+35:9275:x1875746000818176:12345-192.168.204.6@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788851096.264749:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+36:9275:x1875746000818176:12345-192.168.204.6@tcp:35:ldlm_bl.0 Request processed in 842us (3323us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788851096.264760:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:2.0:1788851096.273742:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851096.276342:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000818304 00000100:00100000:0.0:1788851096.276427:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000818304 00010000:00010000:0.0:1788851096.276488:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed7e expref: 36 pid: 5861 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851096.276670:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 74 00000100:00100000:0.0:1788851096.276683:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+36:2353:x1875746000818304:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851096.276715:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851096.276723:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed7e expref: 36 pid: 5861 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.276747:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed7e expref: 36 pid: 5861 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.276814:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546600/0x7ad3e1a87957783e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed7e expref: 36 pid: 5861 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.276833:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2ac00) 00010000:00010000:0.0:1788851096.276839:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577899 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.276861:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.276871:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577899 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.276910:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851096.276984:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+35:2353:x1875746000818304:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 305us (3255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851096.276991:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 74 00010000:00010000:1.0:1788851096.277067:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.277076:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.277112:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.277119:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577899 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.277948:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.277955:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851096.277960:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.277981:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577899 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.277996:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2ac00) 00010000:00010000:1.0:1788851096.277999:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788851096.278004:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577899 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.278011:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577899 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851096.278096:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:11585:x1875746000817920:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 33137us (33644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851096.278105:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 195 00000100:00100000:2.0:1788851096.282822:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851096.283000:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000818560 00000100:00100000:1.0:1788851096.283012:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000818560 00000100:00100000:1.0:1788851096.283079:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:1.0:1788851096.283090:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+34:11585:x1875746000818560:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:1.0:1788851096.284273:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+35:11585:x1875746000818560:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 1178us (1495us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788851096.284285:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 53 00010000:00010000:2.0:1788851096.338074:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851096.408593:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851096.408824:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000818816 00000100:00100000:1.0:1788851096.408836:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000818816 00000100:00100000:1.0:1788851096.408925:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 196 00000100:00100000:1.0:1788851096.408935:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+35:11596:x1875746000818816:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:1.0:1788851096.408962:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851096.408983:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795778a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfed9a expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409071:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795778a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409271:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795778a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409285:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795778a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409370:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795778ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409380:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795778ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409388:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795778ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409647:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795778b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409657:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795778b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409665:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795778b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851096.409675:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788851096.409812:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795778a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409821:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795778a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409835:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795778a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409842:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851096.409940:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795778a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409951:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795778a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409965:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:1.0:1788851096.409969:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851096.409974:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795778a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409981:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795778a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.409995:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795778ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.410001:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795778ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.410007:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795778ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.410012:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851096.410015:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795778ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.410031:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795778ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.410040:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9b9199aa00) 00010000:00010000:1.0:1788851096.410042:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851096.410045:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795778ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.410050:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a8795778ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.410163:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795778a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed9a expref: 38 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.410178:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795778b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed9a expref: 37 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.410185:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2ac00) 00010000:00010000:1.0:1788851096.410187:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851096.410189:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58800, rc 0) 00000100:00100000:1.0:1788851096.410367:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+37:11596:x1875746000818816:12345-192.168.204.6@tcp:101:cat.0 Request processed in 1432us (1784us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788851096.410375:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 196 00000100:00100000:0.0:1788851096.418550:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851096.419611:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000819072 00000100:00100000:2.0:1788851096.419626:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000819072 00000100:00100000:2.0:1788851096.419700:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:2.0:1788851096.419712:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+37:11596:x1875746000819072:12345-192.168.204.6@tcp:35:cat.0 00000100:00100000:2.0:1788851096.420039:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+38:11596:x1875746000819072:12345-192.168.204.6@tcp:35:cat.0 Request processed in 328us (1500us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788851096.420047:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:2.0:1788851096.460478:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851096.463129:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000819328 00000100:00100000:3.0:1788851096.463164:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000819328 00000100:00100000:3.0:1788851096.463239:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 197 00000100:00100000:3.0:1788851096.463249:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+38:11597:x1875746000819328:12345-192.168.204.6@tcp:36:rm.0 00010000:00010000:3.0:1788851096.463314:0:8079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788851096.463344:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795778b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed9a expref: 38 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.463371:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546800/0x7ad3e1a87957788b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed93 expref: 37 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.463384:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879577853 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed85 expref: 36 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.463395:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2ac00) 00010000:00010000:3.0:1788851096.463405:0:8079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851096.463427:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795778c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.463442:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795778c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.463452:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795778c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.463465:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795778ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.463472:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795778ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.463478:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795778ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.463725:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778d1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.463733:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.463740:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851096.464732:0:8079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788851096.464746:0:8079:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 429405963892ns, next at 430405960414ns, rc = 0 00010000:00010000:3.0:1788851096.464878:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795778d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.464892:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795778d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.464903:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795778d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.464910:0:8079:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795778d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.464915:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795778d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.464921:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795778d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.464951:0:8079:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851096.464974:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778d1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.466280:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851096.466293:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795778d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.467644:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778d1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.467654:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.473182:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4600 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851096.473218:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795778d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.473235:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795778d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.473257:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2a100) 00010000:00010000:1.0:1788851096.473261:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788851096.473267:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795778d8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.473273:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4600/0x7ad3e1a8795778d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.473299:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851096.473301:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851096.473305:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851096.473427:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851096.473435:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778d1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.473443:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778d1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.473453:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8a9b87c2a100) 00010000:00010000:3.0:1788851096.473456:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788851096.473459:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778d1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.473466:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778d1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.473499:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795778c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.473507:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795778c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.473516:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795778c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.473521:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851096.473531:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795778c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.473538:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795778c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.473546:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:3.0:1788851096.473548:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851096.473552:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795778c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.473558:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795778c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851096.473571:0:8079:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000057ae159 reply state 00000000e5aef7a1 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795778ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851096.473581:0:8079:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851096.473685:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+37:11597:x1875746000819328:12345-192.168.204.6@tcp:36:rm.0 Request processed in 10432us (13212us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788851096.473695:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 197 00010000:00010000:2.0:1788851096.478268:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795778ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.478289:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795778ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.478298:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795778ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.478305:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851096.478310:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795778ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.478318:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795778ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.478337:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9b87c2a700) 00010000:00010000:2.0:1788851096.478340:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851096.478363:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795778ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851096.478370:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a8795778ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851096.560207:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851096.560693:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000819584 00000100:00100000:3.0:1788851096.560706:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000819584 00000100:00100000:3.0:1788851096.560775:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 198 00000100:00100000:3.0:1788851096.560825:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+36:11603:x1875746000819584:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1788851096.560866:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851096.560892:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795778df lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeda1 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.561029:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.561065:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.561079:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.561098:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795778ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.561106:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795778ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.561113:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795778ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788851096.562598:0:5861:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788851096.563374:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795778f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.563392:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795778f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.563405:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795778f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.563460:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.563468:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.563474:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.563480:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851096.563485:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.563492:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.563505:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:0.0:1788851096.563509:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851096.563514:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.563520:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a8795778e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851096.563536:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000664cccaa reply state 00000000bfffe9f2 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795778ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851096.563545:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788851096.563582:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795778df lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda1 expref: 39 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.565700:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795778f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda1 expref: 38 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.565722:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:0.0:1788851096.565725:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851096.565729:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6a00, rc 0) 00000100:00100000:0.0:1788851096.566007:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+39:11603:x1875746000819584:12345-192.168.204.6@tcp:101:bash.0 Request processed in 5184us (5808us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788851096.566017:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 198 00010000:00010000:1.0:1788851096.585584:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795778ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.585617:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795778ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.585626:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795778ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.585633:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851096.585638:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795778ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.585647:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795778ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.585692:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9b87c2a100) 00010000:00010000:1.0:1788851096.585695:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851096.585702:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795778ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.585708:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795778ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851096.585956:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851096.586176:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000819712 00000100:00100000:0.0:1788851096.586187:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000819712 00000100:00100000:0.0:1788851096.586264:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:0.0:1788851096.586276:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2354:x1875746000819712:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:0.0:1788851096.586298:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851096.586319:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001a7c180/0x7ad3e1a879577902 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeda8 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851096.586348:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851096.586374:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=429s v=(0 0) 00010000:00010000:0.0:1788851096.586378:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851096.586387:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001a7c180/0x7ad3e1a879577902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda8 expref: 6 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.586407:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001a7c180/0x7ad3e1a879577902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda8 expref: 6 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.586433:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7600, rc 0) 00000100:00100000:0.0:1788851096.586496:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2354:x1875746000819712:12345-192.168.204.6@tcp:101:bash.0 Request processed in 222us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851096.586503:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00080000:2.0:1788851096.586572:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851096.594074:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019684864:0@lo:400:kworker.0 00000100:00100000:1.0:1788851096.594133:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019685120:0@lo:400:kworker.0 00000100:00100000:3.0:1788851096.594151:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851096.594165:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851096.594227:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019684736:0@lo:400:kworker.0 00000100:00100000:0.0:1788851096.594267:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851096.594339:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019685376:0@lo:400:kworker.0 00000100:00100000:3.0:1788851096.594364:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851096.594388:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875746019684992:0@lo:400:kworker.0 00000100:00100000:2.0:1788851096.594419:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851096.603740:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019685120 00000100:00100000:1.0:1788851096.603756:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019685120 00000100:00100000:1.0:1788851096.603832:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019685376 00000100:00100000:1.0:1788851096.603837:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019685376 00000100:00100000:1.0:1788851096.603880:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788851096.603890:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1875746019685120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851096.603981:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1875746019685120:12345-0@lo:400:kworker.0 Request processed in 92us (9814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851096.603988:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788851096.604006:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788851096.604013:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875746019685376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851096.604045:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875746019685376:12345-0@lo:400:kworker.0 Request processed in 33us (9680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851096.604050:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788851096.604068:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851096.604072:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851096.604102:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1dd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019685120:0@lo:400:kworker.0 00000100:00100000:1.0:1788851096.604643:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019684864 00000100:00100000:1.0:1788851096.604651:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019684864 00000100:00100000:1.0:1788851096.604682:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019684992 00000100:00100000:1.0:1788851096.604685:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019684992 00000100:00100000:1.0:1788851096.604713:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788851096.604720:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019684864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851096.604763:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019684864:12345-0@lo:400:kworker.0 Request processed in 43us (10612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851096.604769:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788851096.604802:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788851096.604809:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875746019684992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851096.604865:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875746019684992:12345-0@lo:400:kworker.0 Request processed in 57us (10446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851096.604871:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1788851096.604889:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851096.604943:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019684736 00000100:00100000:1.0:1788851096.604947:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019684736 00000100:00100000:1.0:1788851096.604974:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788851096.604981:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019684736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851096.605016:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019684736:12345-0@lo:400:kworker.0 Request processed in 36us (10748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851096.605022:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788851096.605100:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851096.605120:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000819840 00000100:00100000:1.0:1788851096.605124:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000819840 00000100:00100000:1.0:1788851096.605147:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:1.0:1788851096.605154:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:11603:x1875746000819840:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1788851096.605178:0:8281:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851096.605198:0:8281:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfedaf expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.605228:0:8281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001a7c180/0x7ad3e1a879577902 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda8 expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.605239:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851096.605244:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851096.605250:0:8281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 7 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.605283:0:8281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001a7c180/0x7ad3e1a879577902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda8 expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.605297:0:8281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001a7c180/0x7ad3e1a879577902 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda8 expref: 7 pid: 6706 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851096.605313:0:8281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8281:1875746019685632:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851096.609306:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1dd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019684736:0@lo:400:kworker.0 00000100:00100000:0.0:1788851096.609326:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019685248:0@lo:400:kworker.0 00000100:00100000:0.0:1788851096.609402:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851096.609493:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019685248 00000100:00100000:0.0:1788851096.609500:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019685248 00000100:00100000:0.0:1788851096.609563:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788851096.609572:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019685248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851096.613329:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019685248:12345-0@lo:400:kworker.0 Request processed in 3746us (3915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851096.613345:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:0.0:1788851096.613395:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851096.613439:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1dd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019685248:0@lo:400:kworker.0 00000100:00100000:3.0:1788851096.617527:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1dd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019685376:0@lo:400:kworker.0 00000100:00100000:3.0:1788851096.617581:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1dd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019684864:0@lo:400:kworker.0 00000100:00100000:2.0:1788851096.621809:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1dd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875746019684992:0@lo:400:kworker.0 00000100:00100000:2.0:1788851096.621830:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3c1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019685504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851096.621922:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851096.622085:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019685504 00000100:00100000:0.0:1788851096.622093:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019685504 00000100:00100000:0.0:1788851096.622148:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788851096.622158:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875746019685504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851096.622204:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788851096.622280:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875746019685504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851096.622287:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788851096.622320:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3c1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019685504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851096.624993:0:8281:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc29e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851096.626249:0:8281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8281:1875746019685632:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851096.626294:0:8281:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 7 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.626319:0:8281:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58000, rc 0) 00000100:00100000:1.0:1788851096.626415:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:11603:x1875746000819840:12345-192.168.204.6@tcp:101:bash.0 Request processed in 21258us (21314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851096.626425:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:2.0:1788851096.627380:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851096.628509:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000819968 00000100:00100000:1.0:1788851096.628522:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000819968 00010000:00010000:1.0:1788851096.628567:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001a7c180/0x7ad3e1a879577902 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda8 expref: 7 pid: 6706 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851096.629241:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 75 00000100:00100000:3.0:1788851096.629258:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b906b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000819968:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851096.629275:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851096.630285:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001a7c180/0x7ad3e1a879577902 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda8 expref: 7 pid: 6706 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.630453:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001a7c180/0x7ad3e1a879577902 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda8 expref: 7 pid: 6706 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.630484:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001a7c180/0x7ad3e1a879577902 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda8 expref: 7 pid: 6706 timeout: 529 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.630511:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851096.630516:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851096.630526:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 6 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.630538:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 6 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.630592:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 6 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851096.630637:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5846:1875746019685760:192.168.204.6@tcp:105: 00000100:00100000:1.0:1788851096.630990:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc29e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788851096.636153:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851096.636260:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000820224 00000100:00100000:3.0:1788851096.636270:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000820224 00000100:00100000:3.0:1788851096.636372:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:3.0:1788851096.636383:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+38:11603:x1875746000820224:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:3.0:1788851096.636804:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+39:11603:x1875746000820224:12345-192.168.204.6@tcp:35:bash.0 Request processed in 398us (637us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788851096.636813:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:1.0:1788851096.644810:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5846:1875746019685760:192.168.204.6@tcp:105: 00010000:00010000:1.0:1788851096.644852:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851096.645154:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b906b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000819968:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 15897us (17774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851096.645167:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 75 00000100:00100000:2.0:1788851096.941445:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851096.941546:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000820352 00000100:00100000:1.0:1788851096.941558:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000820352 00000100:00100000:1.0:1788851096.941695:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 199 00000100:00100000:1.0:1788851096.941708:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+39:11619:x1875746000820352:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851096.941740:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851096.941765:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577910 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfedb6 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.942084:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577917 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.942102:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.942116:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851096.942154:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788851096.942158:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788851096.942177:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.942205:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577910 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedb6 expref: 41 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.942405:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577917 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedb6 expref: 40 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.942416:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:1.0:1788851096.942420:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788851096.942425:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58e00, rc 0) 00000100:00100000:1.0:1788851096.942650:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+40:11619:x1875746000820352:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 943us (1216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851096.942659:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 199 00000100:00100000:2.0:1788851096.963862:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851096.963994:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000820608 00000100:00100000:0.0:1788851096.964005:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000820608 00000100:00100000:0.0:1788851096.964082:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 200 00000100:00100000:0.0:1788851096.964094:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+40:11619:x1875746000820608:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1788851096.964118:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851096.964142:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a87957791e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfedbd expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.964256:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577925 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.964273:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.964287:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577925 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851096.964300:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788851096.964447:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a87957791e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedbd expref: 43 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.964469:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577925 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedbd expref: 42 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.964500:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:0.0:1788851096.964504:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851096.964508:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6600, rc 0) 00000100:00100000:0.0:1788851096.964575:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+42:11619:x1875746000820608:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 482us (744us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788851096.964582:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 200 00000100:00100000:2.0:1788851096.967998:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851096.968192:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000820736 00000100:00100000:3.0:1788851096.968204:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000820736 00000100:00100000:3.0:1788851096.968275:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:3.0:1788851096.968287:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+42:2354:x1875746000820736:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851096.968304:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851096.968333:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577925 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedbd expref: 42 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.968356:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:3.0:1788851096.968362:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851096.968514:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+41:2354:x1875746000820736:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 228us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851096.968522:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:1.0:1788851096.982543:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851096.982644:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000820992 00000100:00100000:0.0:1788851096.982655:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000820992 00000100:00100000:0.0:1788851096.982714:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 201 00000100:00100000:0.0:1788851096.982725:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+41:11619:x1875746000820992:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1788851096.982757:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851096.982825:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577933 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfedc4 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.982954:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957793a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.982971:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957793a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.982985:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957793a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851096.982999:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788851096.983164:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577933 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedc4 expref: 44 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.983208:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957793a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedc4 expref: 43 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851096.983217:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:0.0:1788851096.983220:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788851096.983224:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7600, rc 0) 00000100:00100000:0.0:1788851096.983295:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+43:11619:x1875746000820992:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 571us (762us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788851096.983303:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 201 00000100:00100000:2.0:1788851096.992897:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851096.993232:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000821120 00000100:00100000:1.0:1788851096.993244:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000821120 00000100:00100000:1.0:1788851096.993310:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:1.0:1788851096.993321:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+6:2353:x1875746000821120:12345-192.168.204.6@tcp:1:lfs.0 00010000:00010000:1.0:1788851096.993375:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577948 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.993397:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 6 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.993408:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851096.993413:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788851096.993418:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577948 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.993458:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 6 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851096.993494:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 6 pid: 8281 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851096.993511:0:6704:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1875746019685888:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851096.993615:0:6704:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc29e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788851096.996919:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851096.997028:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000821248 00000100:00100000:3.0:1788851096.997045:0:6713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000821248 00002000:00100000:3.0:1788851096.997116:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8a9bb3c1f480 x1875746000821248/t0(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:162/0 lens 504/0 e 0 to 0 dl 1788851107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851096.997129:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bb3c1f480 with x1875746000821248 ext(0->8) 00010000:00010000:3.0:1788851096.997139:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 7 pid: 8281 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.997184:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 7 pid: 8281 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851096.997195:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a9bb3c1f480 00000100:00100000:3.0:1788851096.997241:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:1.0:1788851096.997250:0:6704:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1875746019685888:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851096.997259:0:6713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2354:x1875746000821248:12345-192.168.204.6@tcp:4:lfs.0 00010000:00010000:1.0:1788851096.997287:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577948 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851096.997896:0:6713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:2354:x1875746000821248:12345-192.168.204.6@tcp:4:lfs.0 Request processed in 642us (984us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788851096.997907:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 3 00002000:00100000:3.0:1788851096.997915:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8a9bb3c1f480 x1875746000821248/t4294967308(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:162/0 lens 504/448 e 0 to 0 dl 1788851107 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788851096.997925:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bb3c1f480 with x1875746000821248 ext(0->8) 00010000:00010000:3.0:1788851096.997933:0:6713:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 9 pid: 8281 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851096.997947:0:6713:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 9 pid: 8281 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851096.997955:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8a9bb3c1f480 00000100:00100000:2.0:1788851097.000914:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851097.001013:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000821376 00000100:00100000:0.0:1788851097.001024:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000821376 00010000:00010000:0.0:1788851097.001082:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 9 pid: 8281 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851097.001129:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 76 00000100:00100000:0.0:1788851097.001139:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:2353:x1875746000821376:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851097.001158:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788851097.001181:0:6721:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788851097.001184:0:6721:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788851096 00002000:00010000:0.0:1788851097.001186:0:6721:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788851096 00002000:00010000:0.0:1788851097.001188:0:6721:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788851096 00010000:00010000:0.0:1788851097.001195:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 9 pid: 8281 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.001209:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 9 pid: 8281 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.001253:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000379e043e/0x7ad3e1a879577909 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedaf expref: 9 pid: 8281 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.001273:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851097.001278:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851097.001284:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.001295:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577948 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.001338:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851097.001408:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2353:x1875746000821376:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 269us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851097.001416:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 76 00010000:00010000:1.0:1788851097.001576:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.001588:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.001627:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577948 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.001646:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577948 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.001656:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.001680:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58200 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851097.001686:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.001695:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577948 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.001708:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577948 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.001715:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0484133/0x7ad3e1a879577948 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851097.001776:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000821120:12345-192.168.204.6@tcp:1:lfs.0 Request processed in 8457us (8890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851097.001843:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:2.0:1788851097.004234:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851097.004448:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000821632 00000100:00100000:3.0:1788851097.004464:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000821632 00000100:00100000:3.0:1788851097.004547:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:3.0:1788851097.004559:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b912ad450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+43:11619:x1875746000821632:12345-192.168.204.6@tcp:35:lfs.0 00000004:00010000:3.0:1788851097.004659:0:5865:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957793a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedc4 expref: 43 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851097.005059:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788851097.005124:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788851097.005742:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788851097.005955:0:5865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957794f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.006040:0:5865:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795778f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda1 expref: 47 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.006051:0:5865:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957794f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.006154:0:5865:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795778f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda1 expref: 47 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.006173:0:5865:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795778f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda1 expref: 47 pid: 5861 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851097.006191:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1dd5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5865:1875746019686016:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851097.006388:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851097.011033:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851097.011907:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000821760 00000100:00100000:1.0:1788851097.011923:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000821760 00010000:00010000:1.0:1788851097.011975:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795778f4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda1 expref: 48 pid: 5861 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851097.012022:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 77 00000100:00100000:1.0:1788851097.012032:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+48:2354:x1875746000821760:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851097.012061:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851097.012067:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795778f4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda1 expref: 48 pid: 5861 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.012099:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795778f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda1 expref: 48 pid: 5861 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.012125:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:1.0:1788851097.012131:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957794f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.012141:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957794f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.012149:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957794f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.012171:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851097.012240:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+48:2354:x1875746000821760:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 210us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851097.012248:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 77 00010000:00010000:2.0:1788851097.012492:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795778f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeda1 expref: 47 pid: 5861 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851097.012513:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1dd5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5865:1875746019686016:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851097.012547:0:5865:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957794f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851097.012556:0:5865:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957794f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851097.012563:0:5865:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957794f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851097.012719:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788851097.012999:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1788851097.013127:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3c1ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1875746019686144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788851097.013187:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851097.013224:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafdaea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788851097.013415:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019686144 00000100:00100000:1.0:1788851097.013421:0:5867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019686144 00000100:00100000:1.0:1788851097.013466:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788851097.013475:0:5867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5865:x1875746019686144:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788851097.013562:0:5867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5865:x1875746019686144:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 88us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851097.013569:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851097.014189:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3c1ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1875746019686144:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788851097.015482:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788851097.015574:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3c1ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1875746019686272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788851097.015766:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851097.015901:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafdae600 going to sleep for 11 seconds 00000100:00100000:1.0:1788851097.031182:0:5867:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019686272 00000100:00100000:1.0:1788851097.031196:0:5867:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019686272 00000100:00100000:1.0:1788851097.031256:0:5867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788851097.031265:0:5867:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5865:x1875746019686272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788851097.031573:0:5867:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5865:x1875746019686272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 307us (15805us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788851097.031581:0:5867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788851097.032010:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3c1ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5865:1875746019686272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788851097.032139:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1788851097.032212:0:5865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957794f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.032226:0:5865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957794f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.032247:0:5865:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957794f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.032253:0:5865:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851097.032258:0:5865:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957794f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.032267:0:5865:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957794f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.032286:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:3.0:1788851097.032289:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788851097.032295:0:5865:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957794f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.032301:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a87957794f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5865 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788851097.032542:0:5865:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788851097.032676:0:5865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1788851097.032690:0:5865:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 429973907783ns, next at 430973905023ns, rc = 0 00000001:00080000:3.0:1788851097.032697:0:5865:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1788851097.032743:0:5865:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794700) 00010000:00010000:3.0:1788851097.032747:0:5865:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788851097.032754:0:5865:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957793a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedc4 expref: 51 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851097.032939:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b912ad450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+50:11619:x1875746000821632:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 28381us (28713us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1788851097.032960:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 56 00000020:00080000:3.0:1788851097.032966:0:5865:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788851097.037950:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851097.038035:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000821888 00000100:00100000:0.0:1788851097.038044:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000821888 00000100:00100000:0.0:1788851097.038114:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 202 00000100:00100000:0.0:1788851097.038125:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baeff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+50:11619:x1875746000821888:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1788851097.038151:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851097.038175:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577956 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfedcb expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.038243:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedcb expref: 51 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.038278:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedcb expref: 51 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.038301:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851097.038305:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851097.038310:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6000, rc 0) 00000100:00100000:0.0:1788851097.038382:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baeff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:11619:x1875746000821888:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 258us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851097.038389:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 202 00000100:00100000:2.0:1788851097.041365:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851097.041483:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000822144 00000100:00100000:0.0:1788851097.041497:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000822144 00000100:00100000:0.0:1788851097.041564:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:0.0:1788851097.041576:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+51:11619:x1875746000822144:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:0.0:1788851097.042143:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:11619:x1875746000822144:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 567us (791us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788851097.042153:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:2.0:1788851097.106198:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788851097.106232:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019686400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851097.106330:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851097.107103:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019686400 00000100:00100000:3.0:1788851097.107118:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019686400 00000100:00100000:3.0:1788851097.107200:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788851097.107212:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb39b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875746019686400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851097.107240:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851097.107310:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb39b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875746019686400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851097.107317:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788851097.107604:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1dd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019686400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851097.140146:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851097.140246:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000822272 00000100:00100000:0.0:1788851097.140263:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000822272 00000100:00100000:0.0:1788851097.140347:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 203 00000100:00100000:0.0:1788851097.140359:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:11629:x1875746000822272:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:0.0:1788851097.140452:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957795d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.140471:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957795d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.140506:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957795d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.140524:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.140532:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.140538:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.140650:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957796b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.140658:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957796b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.141026:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957796b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851097.141078:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957796b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.141094:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957795d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.141101:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957795d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.141108:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957795d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.141126:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851097.141131:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957795d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.141140:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957795d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.141154:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:0.0:1788851097.141157:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851097.141162:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957795d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.141169:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a87957795d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.141184:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.141190:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577964 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.141196:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.141200:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851097.141203:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.141208:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577964 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.141227:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9ba0794a00) 00010000:00010000:0.0:1788851097.141229:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851097.141232:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577964 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.141238:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577964 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.142065:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957796b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.142080:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957796b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.142086:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957796b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.142092:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851097.142096:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957796b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.142102:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957796b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.142115:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851097.142117:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851097.142121:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957796b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.142127:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957796b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851097.142745:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:11629:x1875746000822272:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 2380us (2602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851097.142757:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 203 00000001:00080000:3.0:1788851097.197426:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788851097.197530:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1788851097.242604:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851097.242753:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000822528 00000100:00100000:0.0:1788851097.242765:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000822528 00000100:00100000:0.0:1788851097.242867:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 204 00000100:00100000:0.0:1788851097.242879:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+52:11632:x1875746000822528:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1788851097.242905:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851097.242929:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577972 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfedd2 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243007:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577979 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243023:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577979 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243036:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577979 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243067:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577980 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243076:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243083:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243243:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577987 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243252:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243258:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577987 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851097.243270:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788851097.243394:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577979 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243402:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577979 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243408:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577979 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243421:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851097.243426:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577979 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243434:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577979 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243447:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:0.0:1788851097.243451:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851097.243456:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577979 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243474:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879577979 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243490:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243497:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577980 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243504:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243509:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851097.243512:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243518:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577980 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243526:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9ba0794a00) 00010000:00010000:0.0:1788851097.243529:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851097.243532:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577980 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243538:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577980 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243582:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577972 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedd2 expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243598:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577987 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedd2 expref: 54 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.243612:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851097.243614:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851097.243617:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7600, rc 0) 00000100:00100000:0.0:1788851097.245899:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:11632:x1875746000822528:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 3013us (3308us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788851097.245912:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 204 00000100:00100000:3.0:1788851097.253732:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851097.253838:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000822656 00000100:00100000:1.0:1788851097.253848:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000822656 00000100:00100000:1.0:1788851097.253912:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 205 00000100:00100000:1.0:1788851097.253924:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:11632:x1875746000822656:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:1.0:1788851097.254152:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577995 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.254174:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.254189:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.254217:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.254225:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577995 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.254234:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.254241:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851097.254246:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.254255:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577995 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.254298:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:1.0:1788851097.254301:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788851097.254307:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577995 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.254314:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577995 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851097.254394:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:11632:x1875746000822656:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 472us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851097.254402:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 205 00000100:00100000:1.0:1788851097.263602:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851097.263690:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000822912 00000100:00100000:3.0:1788851097.263702:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000822912 00000100:00100000:3.0:1788851097.263768:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:3.0:1788851097.263779:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+54:11632:x1875746000822912:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1788851097.264233:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:11632:x1875746000822912:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 455us (641us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788851097.264242:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 58 00010000:00010000:3.0:1788851097.362162:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851097.393206:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851097.393326:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000823168 00000100:00100000:0.0:1788851097.393336:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000823168 00000100:00100000:0.0:1788851097.393399:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 206 00000100:00100000:0.0:1788851097.393410:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+55:11642:x1875746000823168:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:0.0:1788851097.393438:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851097.393442:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788851097.393473:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577917 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedb6 expref: 55 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.393495:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:0.0:1788851097.393501:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851097.393516:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957799c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfedd9 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.393868:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795779a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.393885:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795779a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.393897:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795779a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851097.393928:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788851097.394242:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a87957799c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedd9 expref: 57 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.394259:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795779a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedd9 expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.394267:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851097.394270:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851097.394274:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7c00, rc 0) 00000100:00100000:0.0:1788851097.394459:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:11642:x1875746000823168:12345-192.168.204.6@tcp:101:bash.0 Request processed in 1050us (1263us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788851097.394467:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 206 00000100:00100000:2.0:1788851097.409106:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851097.409228:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000823424 00000100:00100000:0.0:1788851097.409238:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000823424 00000100:00100000:0.0:1788851097.409303:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 207 00000100:00100000:0.0:1788851097.409313:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:11642:x1875746000823424:12345-192.168.204.6@tcp:36:bash.0 00010000:00010000:0.0:1788851097.409381:0:5861:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788851097.409414:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795779a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedd9 expref: 56 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.409439:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577987 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedd2 expref: 55 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.409450:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851097.409455:0:5861:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851097.409707:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.409724:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.409735:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788851097.409865:0:5861:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788851097.409893:0:5861:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc49cdaa reply state 000000000c3c1778 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851097.409902:0:5861:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788851097.410001:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:11642:x1875746000823424:12345-192.168.204.6@tcp:36:bash.0 Request processed in 688us (903us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788851097.410008:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 207 00000020:00080000:0.0:1788851097.410014:0:5861:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788851097.416738:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.416760:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.416837:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.416845:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851097.416850:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.416860:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.416879:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:3.0:1788851097.416883:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851097.416889:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.416895:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851097.419821:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851097.420097:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000823552 00000100:00100000:3.0:1788851097.420289:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000823552 00000100:00100000:3.0:1788851097.420356:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 208 00000100:00100000:3.0:1788851097.420368:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+56:11642:x1875746000823552:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1788851097.420399:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851097.420423:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795779b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfede0 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.420692:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795779bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.420709:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795779bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.420739:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795779bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851097.420774:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788851097.420779:0:8079:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788851097.420880:0:8079:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795779bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.420912:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a8795779b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfede0 expref: 58 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.420933:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795779bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfede0 expref: 57 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.420942:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:3.0:1788851097.420945:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851097.420950:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a5c00, rc 0) 00000100:00100000:3.0:1788851097.421086:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:11642:x1875746000823552:12345-192.168.204.6@tcp:101:bash.0 Request processed in 720us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851097.421095:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 208 00000100:00100000:2.0:1788851097.443454:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851097.443609:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000823808 00000100:00100000:0.0:1788851097.443620:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000823808 00000100:00100000:0.0:1788851097.443684:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:0.0:1788851097.443694:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+57:11642:x1875746000823808:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:0.0:1788851097.444022:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+58:11642:x1875746000823808:12345-192.168.204.6@tcp:35:bash.0 Request processed in 328us (588us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1788851097.444031:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:2.0:1788851097.607479:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851097.607696:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000823936 00000100:00100000:0.0:1788851097.607706:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000823936 00000100:00100000:0.0:1788851097.607771:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 209 00000100:00100000:0.0:1788851097.607812:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+58:11648:x1875746000823936:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1788851097.607852:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851097.607889:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795779c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfede7 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.607974:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795779cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.607989:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795779cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.608001:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795779cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851097.608056:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788851097.608061:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788851097.608079:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795779cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.608104:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a8795779c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfede7 expref: 60 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.608122:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795779cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfede7 expref: 59 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.608130:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:0.0:1788851097.608132:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851097.608137:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7c00, rc 0) 00000100:00100000:0.0:1788851097.608202:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4169180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+59:11648:x1875746000823936:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 422us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851097.608209:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 209 00000100:00100000:2.0:1788851097.618947:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851097.619025:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000824064 00000100:00100000:0.0:1788851097.619058:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000824064 00000100:00100000:0.0:1788851097.619186:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 210 00000100:00100000:0.0:1788851097.619219:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+59:11648:x1875746000824064:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1788851097.619254:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851097.619289:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfedee expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619375:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795779db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619391:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795779db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619404:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795779db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619418:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a8795779e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619424:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a8795779e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619430:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a8795779e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619519:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619525:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619531:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851097.619572:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788851097.619575:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788851097.619605:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619617:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619625:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795779db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619632:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795779db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619639:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795779db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619646:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851097.619848:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795779db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619858:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795779db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619872:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:0.0:1788851097.619875:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851097.619881:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795779db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619887:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a8795779db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619912:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a8795779e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619918:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a8795779e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619925:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a8795779e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619931:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851097.619934:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a8795779e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619939:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a8795779e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619947:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9ba0794a00) 00010000:00010000:0.0:1788851097.619949:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851097.619952:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a8795779e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619958:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a8795779e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.619990:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedee expref: 61 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.620005:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedee expref: 60 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.620026:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851097.620029:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851097.620031:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6c00, rc 0) 00000100:00100000:0.0:1788851097.620110:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4168380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+60:11648:x1875746000824064:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 915us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851097.620117:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 210 00000100:00100000:2.0:1788851097.624729:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851097.624904:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000824192 00000100:00100000:0.0:1788851097.624915:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000824192 00000100:00100000:0.0:1788851097.624988:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:0.0:1788851097.624999:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4169500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+60:2353:x1875746000824192:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851097.625017:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851097.625158:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedee expref: 60 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.625180:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851097.625185:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851097.625242:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4169500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+59:2353:x1875746000824192:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 246us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851097.625249:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:2.0:1788851097.635166:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851097.635347:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000824448 00000100:00100000:0.0:1788851097.635357:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000824448 00000100:00100000:0.0:1788851097.635424:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 211 00000100:00100000:0.0:1788851097.635436:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+59:11648:x1875746000824448:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1788851097.635463:0:5861:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851097.635487:0:5861:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfedf5 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.635650:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.635667:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795779bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfede0 expref: 60 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.635676:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.635719:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795779bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfede0 expref: 60 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.635734:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795779bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfede0 expref: 60 pid: 8079 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851097.635748:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875746019686528:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851097.635991:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf42840 going to sleep for 11 seconds 00000100:00100000:2.0:1788851097.654996:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851097.655397:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000824576 00000100:00100000:3.0:1788851097.655406:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000824576 00010000:00010000:3.0:1788851097.655450:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795779bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfede0 expref: 61 pid: 8079 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851097.655497:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 78 00000100:00100000:3.0:1788851097.655507:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4168700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+61:2353:x1875746000824576:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851097.655539:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851097.655548:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795779bf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfede0 expref: 61 pid: 8079 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.655562:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795779bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfede0 expref: 61 pid: 8079 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.655587:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:3.0:1788851097.655593:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.655604:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.655613:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.655636:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851097.655699:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4168700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+61:2353:x1875746000824576:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 193us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851097.655707:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 78 00010000:00010000:0.0:1788851097.655973:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5c00/0x7ad3e1a8795779bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfede0 expref: 60 pid: 8079 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851097.655994:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ff8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5861:1875746019686528:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788851097.656017:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.656027:0:5861:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.656047:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851097.656069:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788851097.656355:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a8795779f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedf5 expref: 61 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.656373:0:5861:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedf5 expref: 60 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.656381:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851097.656384:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788851097.656387:0:5861:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7400, rc 0) 00000100:00100000:0.0:1788851097.656420:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+60:11648:x1875746000824448:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 20987us (21269us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788851097.656428:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 211 00000100:00100000:2.0:1788851097.661459:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851097.661544:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000824832 00000100:00100000:0.0:1788851097.661556:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000824832 00000100:00100000:0.0:1788851097.661628:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:0.0:1788851097.661639:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+60:11648:x1875746000824832:12345-192.168.204.6@tcp:103:lfs.0 00010000:00010000:0.0:1788851097.661662:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851097.661690:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577956 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedcb expref: 60 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851097.661712:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851097.661718:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851097.661882:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+59:11648:x1875746000824832:12345-192.168.204.6@tcp:103:lfs.0 Request processed in 244us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851097.661890:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:2.0:1788851097.665541:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851097.665701:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000824960 00000100:00100000:3.0:1788851097.665712:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000824960 00000100:00100000:3.0:1788851097.665875:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 212 00000100:00100000:3.0:1788851097.665887:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+59:11648:x1875746000824960:12345-192.168.204.6@tcp:58:lfs.0 00010000:00010000:3.0:1788851097.666101:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577a05 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.666122:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577a05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851097.666161:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577a05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851097.666485:0:8079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788851097.666624:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+59:11648:x1875746000824960:12345-192.168.204.6@tcp:58:lfs.0 Request processed in 738us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851097.666632:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 212 00000100:00100000:3.0:1788851097.674085:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851097.674531:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000825088 00000100:00100000:1.0:1788851097.674543:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000825088 00000100:00100000:1.0:1788851097.674657:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 213 00000100:00100000:1.0:1788851097.674668:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+59:11648:x1875746000825088:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851097.674692:0:5863:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851097.674713:0:5863:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577a0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfedfc expref: -99 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.674777:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577a05 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.674838:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577a0c lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedfc expref: 60 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.674862:0:5863:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577a05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.675018:0:5863:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577a0c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedfc expref: 60 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.675036:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:1.0:1788851097.675039:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788851097.675045:0:5863:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577a0c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedfc expref: 60 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851097.675054:0:5863:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58200, rc 0) 00000100:00100000:1.0:1788851097.675110:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+60:11648:x1875746000825088:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 444us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851097.675119:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 213 00010000:00010000:2.0:1788851098.386062:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851098.386296:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788851098.386302:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788851098.386364:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788851098.386372:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788851098.386514:0:11702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ff8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875746019686656:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788851098.386658:0:11702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf42540 going to sleep for 11 seconds 00000100:00100000:0.0:1788851098.392259:0:11702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ff8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875746019686656:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788851098.409969:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851098.410733:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000825216 00000100:00100000:0.0:1788851098.410747:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000825216 00000100:00100000:0.0:1788851098.410927:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 214 00000100:00100000:0.0:1788851098.410941:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+60:11649:x1875746000825216:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788851098.410987:0:5862:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788851098.412182:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+60:11649:x1875746000825216:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 1236us (2216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.412195:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 214 00000100:00080000:1.0:1788851098.419840:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851098.431208:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851098.436529:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000825344 00000100:00100000:0.0:1788851098.436546:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000825344 00000100:00100000:0.0:1788851098.436687:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 215 00000100:00100000:0.0:1788851098.436698:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+60:11649:x1875746000825344:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788851098.436798:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577a13 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.436830:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577a13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.436861:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577a13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.436917:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577a1a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.436925:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577a1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.436933:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577a1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.436970:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.436980:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.436986:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851098.437030:0:5861:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788851098.437035:0:5861:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788851098.437049:0:5861:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437060:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577a13 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437066:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577a13 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437098:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577a13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437106:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851098.437111:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577a13 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437119:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577a13 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437133:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a9bbcd02f00) 00010000:00010000:0.0:1788851098.437137:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.437142:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577a13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437149:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577a13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437165:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577a1a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437171:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577a1a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437176:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577a1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437181:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851098.437184:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577a1a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437200:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577a1a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437208:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8a9ba0794a00) 00010000:00010000:0.0:1788851098.437211:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.437213:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577a1a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437219:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577a1a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437232:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437237:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437243:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437249:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851098.437251:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437266:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.437273:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851098.437275:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.437278:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.440610:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.441439:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+60:11649:x1875746000825344:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 Request processed in 4733us (10232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.441453:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 215 00000100:00100000:2.0:1788851098.461206:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851098.461836:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000825600 00000100:00100000:3.0:1788851098.461848:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000825600 00000100:00100000:3.0:1788851098.461917:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 216 00000100:00100000:3.0:1788851098.461927:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+60:11649:x1875746000825600:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851098.461960:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851098.461985:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577a28 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee03 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.462101:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.462118:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.462131:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851098.462143:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788851098.462381:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.462408:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.462416:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.462423:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851098.462428:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.462437:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.462452:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:3.0:1788851098.462455:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788851098.462461:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.462467:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.462515:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577a28 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee03 expref: 62 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.462528:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a9bbcd02f00) 00010000:00010000:3.0:1788851098.462530:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851098.462535:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577a28 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee03 expref: 62 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.462545:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4e00, rc 0) 00000100:00100000:3.0:1788851098.463402:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+61:11649:x1875746000825600:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 1471us (2201us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1788851098.463414:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 216 00000100:00100000:2.0:1788851098.468509:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851098.468595:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000825728 00000100:00100000:0.0:1788851098.468604:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000825728 00000100:00100000:0.0:1788851098.468676:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 217 00000100:00100000:0.0:1788851098.468686:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+61:11649:x1875746000825728:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788851098.468728:0:5863:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788851098.468867:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+61:11649:x1875746000825728:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 183us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.469267:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 217 00000100:00100000:2.0:1788851098.476976:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851098.477832:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000825984 00000100:00100000:0.0:1788851098.477844:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000825984 00000100:00100000:0.0:1788851098.477919:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 218 00000100:00100000:0.0:1788851098.477931:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+61:11649:x1875746000825984:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851098.477966:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851098.477971:0:5862:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788851098.478003:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a8795779cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfede7 expref: 61 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.478024:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:0.0:1788851098.478048:0:5862:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851098.478065:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee0a expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788851098.479516:0:5862:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788851098.480531:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577a44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.480552:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.480566:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577a44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.481470:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee0a expref: 63 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.481502:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577a44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee0a expref: 62 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.481513:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a9ba0794a00) 00010000:00010000:0.0:1788851098.481516:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851098.481520:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6c00, rc 0) 00000100:00100000:0.0:1788851098.481619:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+62:11649:x1875746000825984:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 3688us (4651us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788851098.481638:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 218 00000100:00100000:3.0:1788851098.495889:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851098.496084:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000826240 00000100:00100000:0.0:1788851098.496093:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000826240 00000100:00100000:0.0:1788851098.496150:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 219 00000100:00100000:0.0:1788851098.496160:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+62:11649:x1875746000826240:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788851098.496223:0:5863:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851098.496277:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577a44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee0a expref: 62 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496299:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a9ba0794a00) 00010000:00010000:0.0:1788851098.496310:0:5863:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851098.496330:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496345:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496356:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496370:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xa4adf348 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496376:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa4adf348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496383:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa4adf348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496450:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496458:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496465:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496471:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851098.496480:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496489:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496497:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:0.0:1788851098.496500:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.496504:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a52 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496510:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496518:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xa4adf348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496524:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa4adf348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496529:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa4adf348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496535:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851098.496538:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa4adf348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496543:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xa4adf348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496549:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xa4adf348 (ffff8a9ba0794300) 00010000:00010000:0.0:1788851098.496551:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.496557:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa4adf348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.496563:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xa4adf348 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.496650:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+61:11649:x1875746000826240:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 491us (771us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788851098.496657:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 219 00000100:00100000:2.0:1788851098.500681:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851098.500824:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000826368 00000100:00100000:3.0:1788851098.500834:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000826368 00000100:00100000:3.0:1788851098.500896:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 220 00000100:00100000:3.0:1788851098.500905:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+61:11649:x1875746000826368:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851098.500929:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851098.500959:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577a60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee11 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.500999:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.501014:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.501027:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.501140:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4e00/0x7ad3e1a879577a60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee11 expref: 63 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.501159:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee11 expref: 62 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.501168:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a9b87c2a300) 00010000:00010000:3.0:1788851098.501171:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788851098.501181:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4c00, rc 0) 00000100:00100000:3.0:1788851098.501248:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+62:11649:x1875746000826368:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 343us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851098.503333:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 220 00000100:00100000:3.0:1788851098.517687:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851098.518083:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000826624 00000100:00100000:0.0:1788851098.518097:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000826624 00000100:00100000:0.0:1788851098.518168:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 221 00000100:00100000:0.0:1788851098.518181:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+62:11649:x1875746000826624:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788851098.518299:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a6e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.518320:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.518336:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851098.518615:0:5863:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1788851098.518626:0:5863:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 431459843751ns, next at 432459840450ns, rc = 0 00000004:00010000:0.0:1788851098.518724:0:5863:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e2de6f4b reply state 00000000bbc8d5db transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.518733:0:5863:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788851098.519628:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+64:11649:x1875746000826624:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 1442us (1944us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788851098.519638:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 221 00010000:00010000:1.0:1788851098.530370:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a6e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.530390:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a6e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.530398:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.530405:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851098.530410:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a6e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.530437:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a6e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.530455:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a9b87c2a300) 00010000:00010000:1.0:1788851098.530459:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788851098.530466:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a6e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.530473:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577a6e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851098.542425:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851098.543393:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000826752 00000100:00100000:0.0:1788851098.543407:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000826752 00000100:00100000:0.0:1788851098.543481:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 222 00000100:00100000:0.0:1788851098.543512:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+63:11649:x1875746000826752:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851098.543548:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851098.543572:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee18 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.543644:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee18 expref: 64 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.543661:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee18 expref: 64 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.543681:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a9b87c2a300) 00010000:00010000:0.0:1788851098.543685:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851098.543690:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6600, rc 0) 00000100:00100000:0.0:1788851098.543758:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+64:11649:x1875746000826752:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 249us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.543766:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 222 00000100:00100000:2.0:1788851098.557906:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851098.558009:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000826880 00000100:00100000:3.0:1788851098.558020:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000826880 00000100:00100000:3.0:1788851098.558120:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 62 00000100:00100000:3.0:1788851098.558133:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:2353:x1875746000826880:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788851098.558474:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4168000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+10:2353:x1875746000826880:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 345us (580us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788851098.558482:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 62 00000100:00080000:1.0:1788851098.558833:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851098.567514:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851098.567613:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000827136 00000100:00100000:0.0:1788851098.567623:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000827136 00000100:00100000:0.0:1788851098.567686:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:0.0:1788851098.567698:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+64:11649:x1875746000827136:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788851098.568023:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+65:11649:x1875746000827136:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 326us (518us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788851098.568045:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:0.0:1788851098.576831:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851098.577059:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000827392 00000100:00100000:2.0:1788851098.577071:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000827392 00000100:00100000:2.0:1788851098.577131:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 223 00000100:00100000:2.0:1788851098.577143:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+65:11649:x1875746000827392:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788851098.577458:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+65:11649:x1875746000827392:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 316us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851098.577467:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 223 00000100:00100000:2.0:1788851098.585021:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851098.585377:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000827520 00000100:00100000:1.0:1788851098.585389:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000827520 00000100:00100000:1.0:1788851098.585449:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 224 00000100:00100000:1.0:1788851098.585460:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+65:11649:x1875746000827520:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851098.585486:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851098.585510:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577a7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee1f expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.585609:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577a83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.585627:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.585641:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851098.585681:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788851098.585713:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.585741:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58000/0x7ad3e1a879577a7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee1f expref: 67 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.585762:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577a83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee1f expref: 66 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.585773:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a9b87c2a300) 00010000:00010000:1.0:1788851098.585776:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788851098.586196:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59600, rc 0) 00000100:00100000:1.0:1788851098.586273:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+66:11649:x1875746000827520:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 814us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851098.586281:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 224 00000100:00100000:0.0:1788851098.591642:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851098.591747:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000827648 00000100:00100000:1.0:1788851098.591758:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000827648 00000100:00100000:1.0:1788851098.591854:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:1.0:1788851098.591865:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+10:2354:x1875746000827648:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851098.591896:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851098.591921:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577a8a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee26 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788851098.591953:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fb39a, blocks: 0x1 00010000:00010000:1.0:1788851098.591978:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1788851098.591983:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851098.591993:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577a8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee26 expref: 11 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.592024:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577a8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee26 expref: 11 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.592052:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59e00, rc 0) 00000100:00100000:1.0:1788851098.592118:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+11:2354:x1875746000827648:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 255us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851098.592125:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:0.0:1788851098.607353:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851098.607510:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000827904 00000100:00100000:2.0:1788851098.607521:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000827904 00000100:00100000:2.0:1788851098.607589:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 225 00000100:00100000:2.0:1788851098.607618:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+66:11649:x1875746000827904:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788851098.607754:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+66:11649:x1875746000827904:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 138us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851098.607762:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 225 00000100:00100000:3.0:1788851098.618366:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851098.618521:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000828032 00000100:00100000:0.0:1788851098.618533:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000828032 00000100:00100000:0.0:1788851098.618601:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 64 00000100:00100000:0.0:1788851098.618613:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+11:11649:x1875746000828032:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851098.618636:0:6707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851098.618660:0:6707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577a91 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee2d expref: -99 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.618697:0:6707:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577a8a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee26 expref: 12 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.618707:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851098.618712:0:6707:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851098.618717:0:6707:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577a91 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee2d expref: 12 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.618756:0:6707:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577a8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee26 expref: 12 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.618772:0:6707:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577a8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee26 expref: 12 pid: 6706 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.618833:0:6707:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ff8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6707:1875746019686784:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851098.618935:0:6707:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851098.630642:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851098.630711:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851098.630748:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851098.630984:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000828160 00000100:00100000:1.0:1788851098.630996:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000828160 00000100:00100000:1.0:1788851098.631073:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 302 00000100:00100000:1.0:1788851098.631084:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:2352:x1875746000828160:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851098.631163:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+13:2352:x1875746000828160:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 82us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851098.631171:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 302 00000100:00100000:3.0:1788851098.631832:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000828416 00000100:00100000:3.0:1788851098.631839:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000828416 00000100:00100000:3.0:1788851098.631899:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 168 00000100:00100000:3.0:1788851098.631908:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2352:x1875746000828416:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851098.631970:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37963b51-fe0d-42c0-b479-a7af644fd745+5:2352:x1875746000828416:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 64us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851098.631977:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 168 00000100:00080000:1.0:1788851098.632556:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851098.635536:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000828288 00000100:00100000:2.0:1788851098.635561:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000828288 00000100:00100000:2.0:1788851098.635673:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 86 00000100:00100000:2.0:1788851098.635689:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2352:x1875746000828288:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788851098.635838:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2352:x1875746000828288:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 155us (5087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851098.635845:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 86 00000100:00080000:1.0:1788851098.636237:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788851098.638335:0:6707:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ff8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6707:1875746019686784:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788851098.638379:0:6707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577a91 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee2d expref: 12 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.638404:0:6707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7600, rc 0) 00000100:00100000:0.0:1788851098.638471:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+12:11649:x1875746000828032:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 19860us (20116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.638482:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 64 00000100:00100000:3.0:1788851098.664495:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851098.664707:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000828544 00000100:00100000:2.0:1788851098.664718:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000828544 00010000:00010000:2.0:1788851098.664764:0:5848:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577a8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee26 expref: 12 pid: 6706 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851098.664858:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 79 00000100:00100000:2.0:1788851098.664869:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b906b5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+12:2353:x1875746000828544:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851098.664890:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851098.664915:0:5848:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577a8a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee26 expref: 12 pid: 6706 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.664930:0:5848:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577a8a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee26 expref: 12 pid: 6706 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.664988:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577a8a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee26 expref: 12 pid: 6706 timeout: 531 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.665007:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851098.665012:0:5848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851098.665021:0:5848:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577a91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee2d expref: 11 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.665050:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577a91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee2d expref: 11 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.665108:0:5848:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577a91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee2d expref: 11 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851098.665123:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3c27100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5848:1875746019686912:192.168.204.6@tcp:105: 00000100:00100000:2.0:1788851098.665213:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bafdaee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788851098.675462:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3c27100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5848:1875746019686912:192.168.204.6@tcp:105: 00010000:00010000:2.0:1788851098.675495:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851098.675559:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b906b5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+11:2353:x1875746000828544:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 10690us (11076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851098.675572:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 79 00000100:00100000:3.0:1788851098.682348:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851098.682569:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000828672 00000100:00100000:1.0:1788851098.682580:0:6711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000828672 00002000:00100000:1.0:1788851098.682640:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8a9bc1dd7b80 x1875746000828672/t0(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:164/0 lens 504/0 e 0 to 0 dl 1788851109 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788851098.682651:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bc1dd7b80 with x1875746000828672 ext(0->12) 00002000:00010000:1.0:1788851098.682657:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bc1dd7b80 00000100:00100000:1.0:1788851098.682692:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:1.0:1788851098.682702:0:6711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+11:2354:x1875746000828672:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788851098.683469:0:6711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:2354:x1875746000828672:12345-192.168.204.6@tcp:4:lhsmtool_posix.0 Request processed in 764us (1127us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788851098.683479:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 6 00002000:00100000:1.0:1788851098.683488:0:6711:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8a9bc1dd7b80 x1875746000828672/t4294967320(0) o4->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:164/0 lens 504/448 e 0 to 0 dl 1788851109 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788851098.683497:0:6711:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bc1dd7b80 with x1875746000828672 ext(0->12) 00002000:00010000:1.0:1788851098.683501:0:6711:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bc1dd7b80 00000100:00100000:3.0:1788851098.697959:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851098.704232:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000828800 00000100:00100000:2.0:1788851098.704249:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000828800 00000100:00100000:2.0:1788851098.704330:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 226 00000100:00100000:2.0:1788851098.704360:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+66:11649:x1875746000828800:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788851098.791931:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788851098.791962:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788851098.792040:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a9bafdaea80 refcount 2 committed 0 result 0 batchid 7 00000100:00100000:0.0:1788851098.792509:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788851098.792531:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019687040:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788851098.792607:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851098.792684:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019687168:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788851098.792710:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851098.792749:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019687040 00000100:00100000:0.0:1788851098.792756:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019687040 00000100:00100000:0.0:1788851098.792847:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019687168 00000100:00100000:0.0:1788851098.792851:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019687168 00000100:00100000:0.0:1788851098.792872:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788851098.792881:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9ba058c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1875746019687040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788851098.792913:0:8281:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1788851098.793005:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577a98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.793032:0:8281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018187a36/0x7ad3e1a87957785a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed8c expref: 12 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.793056:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1788851098.793061:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851098.793065:0:8281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577a98 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.793331:0:8281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018187a36/0x7ad3e1a87957785a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed8c expref: 12 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.793349:0:8281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018187a36/0x7ad3e1a87957785a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed8c expref: 12 pid: 8281 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.793363:0:8281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8281:1875746019687296:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851098.793436:0:8281:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8623d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788851098.793462:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788851098.793472:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875746019687168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788851098.793642:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788851098.793646:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788851098 00002000:00010000:0.0:1788851098.793649:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788851098.793651:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788851098 -> 1788851098 00002000:00010000:0.0:1788851098.793653:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788851098.793699:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3308:x1875746019687168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (987us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788851098.793708:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788851098.793731:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788851098.793820:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a9bc1ffaa00/2, rc 0, transno 4294967321 00000100:00100000:0.0:1788851098.793827:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019687168:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788851098.794669:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+42:11649:x1875746000828800:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 Request processed in 90306us (96725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851098.794681:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 226 00000020:00080000:3.0:1788851098.795638:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9b87c15700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a9bafdae300 00000020:00080000:3.0:1788851098.795653:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9b87f2bd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a9b98df7c00 00000004:00080000:3.0:1788851098.795716:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:3.0:1788851098.795752:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788851098.795773:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a9b8bd3b300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788851098.795776:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9bbcf45400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a9b8bd3b6c0 00000020:00080000:3.0:1788851098.795793:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9bbcf45500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a9bc1de4800 00000020:00080000:0.0:1788851098.796287:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788851098.796502:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788851098.796514:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851098.796533:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019687424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788851098.796603:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851098.796831:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019687424 00000100:00100000:1.0:1788851098.796840:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019687424 00000100:00100000:1.0:1788851098.796911:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788851098.796921:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019687424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788851098.797087:0:6706:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1788851098.797264:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9fb398, atime: 0x6a9fb398, ctime: 0x6a9fb398, blocks: 0xb 00010000:00010000:1.0:1788851098.797274:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a879577a9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.797291:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=431s v=(0 0) 00010000:00010000:1.0:1788851098.797296:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851098.797303:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a879577a9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.797323:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a879577a9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.797353:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a879577a9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.797361:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a879577a9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.797387:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851098.798494:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851098.798507:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a879577a9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.798518:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58800 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851098.798523:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a879577a9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.798534:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a879577a9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.798555:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a879577a9f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.798563:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000034c20a0/0x7ad3e1a879577a9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.798590:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851098.798592:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851098.798602:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788851098.798665:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851098.799558:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1875746019687424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2632us (2947us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788851098.799571:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788851098.800116:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788851098.800124:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a9b87d75f80, transno 4294967307 00000004:00080000:0.0:1788851098.800141:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1788851098.800165:0:3308:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a9b8bcf0e00 x1875746019687424/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788851114 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788851098.800179:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a9b8bcf0e00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788851098.800185:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019687424:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788851098.800222:0:8281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8281:1875746019687296:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788851098.800242:0:8281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577a98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851098.802582:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851098.802740:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851098.802936:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000829056 00000100:00100000:1.0:1788851098.802959:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000829056 00000100:00100000:1.0:1788851098.803011:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:1.0:1788851098.803023:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:2353:x1875746000829056:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788851098.805728:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000828928 00000100:00100000:0.0:1788851098.805748:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000828928 00010000:00010000:0.0:1788851098.805830:0:5846:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018187a36/0x7ad3e1a87957785a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed8c expref: 14 pid: 8281 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.805878:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 80 00000100:00100000:0.0:1788851098.805890:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+14:2353:x1875746000828928:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851098.805917:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851098.805925:0:5846:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018187a36/0x7ad3e1a87957785a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed8c expref: 14 pid: 8281 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.805940:0:5846:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018187a36/0x7ad3e1a87957785a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed8c expref: 14 pid: 8281 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.805980:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018187a36/0x7ad3e1a87957785a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed8c expref: 14 pid: 8281 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.805998:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851098.806003:0:5846:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851098.806009:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577a98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.806020:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577a98 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.806051:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851098.806477:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+13:2353:x1875746000828928:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 586us (3901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.806488:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 80 00010000:00010000:0.0:1788851098.806519:0:8281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577a98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.806530:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577a98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.806549:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577a98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.806558:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577a98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.806578:0:8281:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788851098.808143:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9ba058c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3310:x1875746019687040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15257us (15531us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788851098.808159:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:0.0:1788851098.808333:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851098.808344:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577a98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.808355:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6a00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851098.808360:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577a98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.808372:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577a98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.808394:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577a98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.808401:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577a98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.808434:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851098.808437:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851098.808438:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788851098.808664:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a9bafcf9f80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788851098.808672:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019687040:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788851098.865614:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1788851098.865637:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1788851098.865857:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000829056:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 Request processed in 62830us (63111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851098.865870:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:2.0:1788851098.885451:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851098.886406:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000829312 00000100:00100000:3.0:1788851098.886418:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000829312 00000100:00100000:3.0:1788851098.886489:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 227 00000100:00100000:3.0:1788851098.886501:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+20:11649:x1875746000829312:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788851098.886561:0:8079:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851098.886591:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577a83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee1f expref: 20 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.886614:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a9b87c2a300) 00010000:00010000:3.0:1788851098.886620:0:8079:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851098.886654:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577aa6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.886671:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577aa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.886682:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577aa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788851098.888493:0:8079:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042279e61 reply state 00000000c119e6f3 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577aa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851098.888512:0:8079:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788851098.888717:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:11649:x1875746000829312:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 2215us (3274us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788851098.888727:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 227 00010000:00010000:3.0:1788851098.893775:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577aa6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.893829:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577aa6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.893837:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577aa6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.893864:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851098.893869:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577aa6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.893879:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577aa6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.893899:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a9b87c2a300) 00010000:00010000:3.0:1788851098.893903:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851098.893909:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577aa6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.893915:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577aa6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851098.895666:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851098.896450:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000829440 00000100:00100000:1.0:1788851098.896481:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000829440 00000100:00100000:1.0:1788851098.897295:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:1.0:1788851098.897316:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2351:x1875746000829440:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788851098.897717:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788851098.897722:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788851098 -> 1788851097 00002000:00010000:1.0:1788851098.897724:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788851096 00002000:00010000:1.0:1788851098.897727:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788851098 -> 1788851097 00002000:00010000:1.0:1788851098.897729:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788851098.897828:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2351:x1875746000829440:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 519us (2171us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788851098.897838:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:0.0:1788851098.902284:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851098.907346:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000829696 00000100:00100000:1.0:1788851098.907364:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000829696 00000100:00100000:1.0:1788851098.907457:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 228 00000100:00100000:1.0:1788851098.907469:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+20:11649:x1875746000829696:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788851098.907551:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577aad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.907570:0:5863:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee11 expref: 20 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.907582:0:5863:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577aad lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.907625:0:5863:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee11 expref: 20 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.907641:0:5863:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee11 expref: 20 pid: 8079 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851098.907676:0:5863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019687552:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851098.907856:0:5863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc29b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851098.913531:0:5863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5863:1875746019687552:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851098.913578:0:5863:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577aad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.915829:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851098.916311:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000829824 00000100:00100000:1.0:1788851098.916323:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000829824 00010000:00010000:1.0:1788851098.916371:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee11 expref: 21 pid: 8079 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851098.916427:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 81 00000100:00100000:1.0:1788851098.916440:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:2353:x1875746000829824:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851098.916458:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851098.916467:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee11 expref: 21 pid: 8079 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.916480:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee11 expref: 21 pid: 8079 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.916506:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4c00/0x7ad3e1a879577a67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee11 expref: 21 pid: 8079 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.916525:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a9b87c2a300) 00010000:00010000:1.0:1788851098.916531:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577aad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.916559:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577aad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.916580:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577aad lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.916621:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851098.916660:0:5863:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577aad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.916670:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577aad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851098.916692:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+20:2353:x1875746000829824:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 253us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851098.916701:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 81 00010000:00010000:3.0:1788851098.916702:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577aad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.916710:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577aad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.916717:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577aad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.916736:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851098.916741:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577aad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.916748:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577aad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.916758:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a9b87c2a300) 00010000:00010000:3.0:1788851098.916760:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788851098.916764:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577aad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.916770:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a879577aad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851098.916864:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:11649:x1875746000829696:12345-192.168.204.6@tcp:55:lhsmtool_posix.0 Request processed in 9398us (14592us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788851098.916875:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 228 00000100:00100000:3.0:1788851098.920506:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851098.920668:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000829952 00000100:00100000:0.0:1788851098.920678:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000829952 00000100:00100000:0.0:1788851098.920740:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00100000:0.0:1788851098.920751:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2354:x1875746000829952:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788851098.922377:0:8281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b98b541d/0x7ad3e1a879577ab4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.922406:0:8281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577a91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee2d expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.922417:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851098.922423:0:8281:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851098.922428:0:8281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b98b541d/0x7ad3e1a879577ab4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.922470:0:8281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577a91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee2d expref: 8 pid: 6707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.922488:0:8281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577a91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee2d expref: 8 pid: 6707 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.922523:0:8281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8281:1875746019687680:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851098.922669:0:8281:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b957a0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788851098.929728:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851098.930504:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000830080 00000100:00100000:3.0:1788851098.930515:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000830080 00010000:00010000:3.0:1788851098.930565:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577a91 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee2d expref: 9 pid: 6707 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851098.930616:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 82 00000100:00100000:3.0:1788851098.930626:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:2353:x1875746000830080:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851098.930646:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851098.930673:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577a91 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee2d expref: 9 pid: 6707 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.930706:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577a91 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee2d expref: 9 pid: 6707 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.930738:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851098.930743:0:6721:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788851098.930750:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b98b541d/0x7ad3e1a879577ab4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.930762:0:6721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b98b541d/0x7ad3e1a879577ab4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.930828:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851098.930885:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+9:2353:x1875746000830080:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 261us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851098.930893:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 82 00010000:00010000:2.0:1788851098.932770:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577a91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee2d expref: 8 pid: 6707 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851098.932860:0:8281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef3ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8281:1875746019687680:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851098.932888:0:8281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b98b541d/0x7ad3e1a879577ab4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.932901:0:8281:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b98b541d/0x7ad3e1a879577ab4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.932909:0:8281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b98b541d/0x7ad3e1a879577ab4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.933152:0:8281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b98b541d/0x7ad3e1a879577ab4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.933162:0:8281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b98b541d/0x7ad3e1a879577ab4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.933171:0:8281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b98b541d/0x7ad3e1a879577ab4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.933206:0:8281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851098.933211:0:8281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b98b541d/0x7ad3e1a879577ab4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.933220:0:8281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b98b541d/0x7ad3e1a879577ab4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.933241:0:8281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b98b541d/0x7ad3e1a879577ab4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.933317:0:8281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b98b541d/0x7ad3e1a879577ab4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851098.933470:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2354:x1875746000829952:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 Request processed in 12719us (12973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851098.933481:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 70 00000100:00100000:0.0:1788851098.937514:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851098.937625:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000830336 00000100:00100000:1.0:1788851098.937634:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000830336 00000100:00100000:1.0:1788851098.937728:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 229 00000100:00100000:1.0:1788851098.937739:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:11649:x1875746000830336:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788851098.938002:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577abb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.938025:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577abb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.938110:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577abb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.938677:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577ac2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.938694:0:8079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a75 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee18 expref: 20 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.938729:0:8079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577ac2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.938771:0:8079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee18 expref: 20 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851098.939383:0:8079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee18 expref: 20 pid: 8079 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851098.939406:0:8079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8079:1875746019687808:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851098.939556:0:8079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc29b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788851098.944932:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851098.945019:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000830464 00000100:00100000:3.0:1788851098.945038:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000830464 00010000:00010000:3.0:1788851098.945096:0:5847:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a75 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee18 expref: 21 pid: 8079 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851098.945142:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 83 00000100:00100000:3.0:1788851098.945154:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:2354:x1875746000830464:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851098.945170:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851098.945177:0:5847:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a75 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee18 expref: 21 pid: 8079 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.945214:0:5847:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a75 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee18 expref: 21 pid: 8079 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.945239:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a9b87c2a300) 00010000:00010000:3.0:1788851098.945251:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577ac2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.945262:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577ac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.945271:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577ac2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.945292:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851098.945404:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879577a75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee18 expref: 21 pid: 8079 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.945423:0:8079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8079:1875746019687808:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788851098.945442:0:8079:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577ac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.945451:0:8079:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577ac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.945458:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577ac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788851098.945664:0:8079:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1788851098.945863:0:8079:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1788851098.945910:0:8079:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1788851098.945998:0:8079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8079:1875746019687936:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788851098.946068:0:8079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851098.946105:0:8079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b957a09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851098.946128:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019687936 00000100:00100000:0.0:1788851098.946134:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019687936 00000100:00100000:0.0:1788851098.946170:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788851098.946177:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8079:x1875746019687936:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788851098.946265:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8079:x1875746019687936:12345-0@lo:1000:mdt00_003.0 Request processed in 88us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851098.946272:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788851098.946305:0:8079:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1788851098.946311:0:8079:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1788851098.946325:0:8079:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a9bc1ffaa00, transno 4294967321 00000100:00100000:0.0:1788851098.946337:0:8079:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8a9bafcf9f80 x1875746019687040/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788851114 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851098.946348:0:8079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8079:1875746019687936:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788851098.946842:0:8079:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1788851098.946901:0:8079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8079:1875746019688064:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788851098.946932:0:8079:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851098.946953:0:8079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8be34900 going to sleep for 11 seconds 00000100:00100000:0.0:1788851098.946970:0:5866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019688064 00000100:00100000:0.0:1788851098.946974:0:5866:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019688064 00000100:00100000:0.0:1788851098.946999:0:5866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788851098.947005:0:5866:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8079:x1875746019688064:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788851098.947158:0:5866:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8079:x1875746019688064:12345-0@lo:1000:mdt00_003.0 Request processed in 151us (223us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788851098.947164:0:5866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788851098.947374:0:8079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef3c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8079:1875746019688064:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788851098.947408:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577ac2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.947419:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577ac2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.947440:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577ac2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.947448:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851098.947453:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577ac2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.947463:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577ac2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.947481:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a9b87c2a300) 00010000:00010000:0.0:1788851098.947484:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851098.947490:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577ac2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.947498:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577ac2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.947534:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577a05 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.947540:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577a05 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.947547:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577a05 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.947553:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851098.947556:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577a05 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.947574:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577a05 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.947583:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851098.947586:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788851098.947592:0:8079:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577a0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedfc expref: 24 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.947604:0:8079:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577a0c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedfc expref: 24 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.947613:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577a0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedfc expref: 24 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.947636:0:8079:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577a0c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedfc expref: 24 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.947648:0:8079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8079:1875746019688192:192.168.204.6@tcp:105: 00000100:00100000:3.0:1788851098.948588:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+24:2354:x1875746000830464:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 3430us (3659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851098.948601:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 83 00000100:00100000:0.0:1788851098.948694:0:8079:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8be34900 going to sleep for 11 seconds 00000100:00100000:1.0:1788851098.952337:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851098.952446:0:8079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8079:1875746019688192:192.168.204.6@tcp:105: 00010000:00010000:0.0:1788851098.952478:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577a05 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952490:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a5400/0x7ad3e1a879577a05 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952530:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ac9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952567:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ac9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952582:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ac9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952597:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ac9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952604:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ac9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952612:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ac9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952619:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851098.952624:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ac9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952633:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ac9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952647:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851098.952651:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851098.952655:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ac9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952662:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ac9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952673:0:8079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577abb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952688:0:8079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577abb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952695:0:8079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577abb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952702:0:8079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851098.952705:0:8079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577abb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952712:0:8079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577abb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952722:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:0.0:1788851098.952724:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788851098.952728:0:8079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577abb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.952734:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577abb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851098.953050:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:11649:x1875746000830336:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 15312us (15544us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788851098.953061:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 229 00000020:00080000:0.0:1788851098.953068:0:8079:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788851098.953517:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000830592 00000100:00100000:2.0:1788851098.953526:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000830592 00000100:00100000:2.0:1788851098.953572:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:2.0:1788851098.953582:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:11648:x1875746000830592:12345-192.168.204.6@tcp:49:lfs.0 00000100:00100000:2.0:1788851098.953688:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:11648:x1875746000830592:12345-192.168.204.6@tcp:49:lfs.0 Request processed in 107us (1362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851098.953696:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 61 00000040:00080000:1.0:1788851098.954133:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851098.954138:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851098.954684:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788851098.954693:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788851098.960242:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851098.960304:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851098.960390:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000831104 00000100:00100000:0.0:1788851098.960401:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000831104 00000100:00100000:0.0:1788851098.960460:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 62 00000100:00100000:0.0:1788851098.960471:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b912afc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+23:11649:x1875746000831104:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788851098.961295:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000830848 00000100:00100000:2.0:1788851098.961302:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000830848 00000100:00100000:2.0:1788851098.961342:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 230 00000100:00100000:2.0:1788851098.961351:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+25:11648:x1875746000830848:12345-192.168.204.6@tcp:58:lfs.0 00000004:00080000:0.0:1788851098.962633:0:5864:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788851098.962702:0:5864:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:0.0:1788851098.962775:0:5864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ad0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.962877:0:5864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.962893:0:5864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ad0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.962902:0:5864:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ad0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.962908:0:5864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ad0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.962914:0:5864:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851098.963111:0:5864:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788851098.963233:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b912afc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:11649:x1875746000831104:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 2761us (2925us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788851098.963254:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 62 00000020:00080000:0.0:1788851098.963260:0:5864:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1788851098.965419:0:5861:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788851098.965526:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+25:11648:x1875746000830848:12345-192.168.204.6@tcp:58:lfs.0 Request processed in 4170us (5290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851098.965538:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 230 00010000:00010000:3.0:1788851098.965927:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851098.966012:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ad0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.966023:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7600 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851098.966152:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ad0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.966167:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ad0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.966186:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8a9ba0794300) 00010000:00010000:3.0:1788851098.966206:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788851098.966212:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ad0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851098.966219:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ad0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5864 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851098.969635:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851098.969645:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851098.969648:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851099.042567:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851099.042665:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000831232 00000100:00100000:0.0:1788851099.042676:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000831232 00000100:00100000:0.0:1788851099.042740:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 231 00000100:00100000:0.0:1788851099.042750:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+25:11651:x1875746000831232:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1788851099.042821:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851099.042855:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577ad7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee34 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.042927:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577ade lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.042956:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577ade lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.042970:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577ade lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.042989:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ae5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.042996:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.043003:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.043268:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577aec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.043280:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedf5 expref: 26 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.043289:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577aec lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.043323:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedf5 expref: 26 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851099.043347:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedf5 expref: 26 pid: 5861 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851099.043361:0:5862:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019688320:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851099.043451:0:5862:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8be34240 going to sleep for 11 seconds 00000100:00100000:0.0:1788851099.050322:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851099.050553:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000831488 00000100:00100000:3.0:1788851099.050563:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000831488 00000100:00100000:3.0:1788851099.050620:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:3.0:1788851099.050631:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+27:5604:x1875746000831488:12345-192.168.204.6@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788851099.050961:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+28:5604:x1875746000831488:12345-192.168.204.6@tcp:35:ldlm_bl.0 Request processed in 331us (651us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788851099.050969:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 63 00000100:00100000:1.0:1788851099.052516:0:5862:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5862:1875746019688320:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851099.052550:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577aec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851099.055371:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851099.055915:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000831616 00000100:00100000:3.0:1788851099.055926:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000831616 00010000:00010000:2.0:1788851099.056149:0:6721:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedf5 expref: 28 pid: 5861 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851099.056195:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 84 00000100:00100000:2.0:1788851099.056205:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+28:2354:x1875746000831616:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851099.056223:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851099.056231:0:6721:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedf5 expref: 28 pid: 5861 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851099.056401:0:6721:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedf5 expref: 28 pid: 5861 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851099.056427:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a8795779f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedf5 expref: 28 pid: 5861 timeout: 531 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851099.056447:0:6721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:2.0:1788851099.056469:0:6721:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577aec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851099.056482:0:6721:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577aec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851099.056491:0:6721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577aec lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851099.056570:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851099.056632:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+27:2354:x1875746000831616:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 427us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851099.056640:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 84 00010000:00010000:1.0:1788851099.058473:0:5862:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577aec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058512:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577aec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851099.058571:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788851099.058577:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788851099.058599:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577aec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058615:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577aec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058628:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577ade lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058634:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577ade lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058640:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577ade lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058646:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851099.058650:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577ade lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058658:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577ade lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058672:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:1.0:1788851099.058675:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851099.058680:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577ade lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058697:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a879577ade lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058715:0:5862:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058721:0:5862:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058727:0:5862:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058731:0:5862:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851099.058734:0:5862:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058741:0:5862:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058753:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8a9ba0794a00) 00010000:00010000:1.0:1788851099.058756:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851099.058759:0:5862:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ae5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058765:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879577ae5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058840:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577ad7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee34 expref: 27 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058855:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577aec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee34 expref: 26 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851099.058867:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:1.0:1788851099.058870:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851099.058872:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6c00, rc 0) 00000100:00100000:1.0:1788851099.058967:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:11651:x1875746000831232:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 16217us (16410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851099.062476:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 231 00010000:00010000:3.0:1788851099.410974:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788851099.986548:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788851099.986559:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851099.986604:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788851099.986614:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788851099.986746:0:11702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875746019688448:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788851099.986897:0:11702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc29780 going to sleep for 11 seconds 00000100:00100000:3.0:1788851099.995310:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851099.995383:0:11702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11702:1875746019688448:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788851099.995570:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000831744 00000100:00100000:3.0:1788851099.995578:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000831744 00000100:00100000:3.0:1788851099.995632:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 232 00000100:00100000:3.0:1788851099.995643:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:11662:x1875746000831744:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788851099.995683:0:5863:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788851099.995841:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:11662:x1875746000831744:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 198us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851099.995850:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 232 00000100:00100000:3.0:1788851100.002325:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851100.002440:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000832000 00000100:00100000:2.0:1788851100.002452:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000832000 00000100:00100000:2.0:1788851100.002512:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 233 00000100:00100000:2.0:1788851100.002524:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+26:11662:x1875746000832000:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851100.002550:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851100.002575:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577af3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee3b expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.002696:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577afa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.002712:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.002726:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577afa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851100.002738:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788851100.002939:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546400/0x7ad3e1a879577af3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee3b expref: 29 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.002961:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577afa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee3b expref: 28 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.002971:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:2.0:1788851100.002974:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851100.002979:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546a00, rc 0) 00000100:00100000:2.0:1788851100.003038:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+28:11662:x1875746000832000:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 516us (723us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788851100.003046:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 233 00000100:00100000:3.0:1788851100.008183:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851100.008236:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000832256 00000100:00100000:1.0:1788851100.008260:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000832256 00000100:00100000:1.0:1788851100.008347:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 234 00000100:00100000:1.0:1788851100.008361:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+28:11662:x1875746000832256:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788851100.008467:0:5863:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577b08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.008490:0:5863:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.008504:0:5863:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.008712:0:5863:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577b08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.008743:0:5863:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577b08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.008752:0:5863:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577b08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.008759:0:5863:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58e00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851100.008764:0:5863:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577b08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.008816:0:5863:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577b08 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.008831:0:5863:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:1.0:1788851100.008834:0:5863:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788851100.008840:0:5863:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577b08 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.008846:0:5863:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577b08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5863 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851100.009021:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1dd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+29:11662:x1875746000832256:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 663us (849us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788851100.009030:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 234 00000040:00080000:3.0:1788851100.009154:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788851100.009160:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00080000:2.0:1788851100.009348:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1788851100.013764:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788851100.013817:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788851100.019149:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851100.019216:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000832512 00000100:00100000:3.0:1788851100.019226:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000832512 00000100:00100000:3.0:1788851100.019286:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 64 00000100:00100000:3.0:1788851100.019297:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+29:11662:x1875746000832512:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788851100.019501:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851100.030502:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+30:11662:x1875746000832512:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 11194us (11353us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788851100.030518:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 64 00000100:00100000:1.0:1788851100.032090:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000832640 00000100:00100000:1.0:1788851100.032106:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000832640 00000100:00100000:1.0:1788851100.032177:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:1.0:1788851100.032187:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+30:2351:x1875746000832640:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851100.032202:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851100.032236:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546a00/0x7ad3e1a879577afa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee3b expref: 30 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.032338:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:1.0:1788851100.032345:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851100.032473:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+29:2351:x1875746000832640:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 287us (12972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851100.032480:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 18 00000040:00080000:2.0:1788851100.152739:0:12587:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788851100.152751:0:12587:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788851100.153110:0:12587:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788851100.153118:0:12587:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788851100.365016:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851100.365110:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000832896 00000100:00100000:1.0:1788851100.365121:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000832896 00000100:00100000:1.0:1788851100.365188:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 235 00000100:00100000:1.0:1788851100.365199:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+29:11675:x1875746000832896:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851100.365232:0:8079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851100.365260:0:8079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577b0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee42 expref: -99 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.365368:0:8079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879577b16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.365383:0:8079:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879577b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.365398:0:8079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879577b16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8079 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851100.365409:0:8079:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788851100.365541:0:8079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58e00/0x7ad3e1a879577b0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee42 expref: 32 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.365562:0:8079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879577b16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee42 expref: 31 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851100.365582:0:8079:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:1.0:1788851100.365586:0:8079:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788851100.365589:0:8079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59e00, rc 0) 00000100:00100000:1.0:1788851100.365650:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+31:11675:x1875746000832896:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 453us (645us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788851100.365657:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 235 00000100:00100000:0.0:1788851100.374560:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851100.379481:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000833024 00000100:00100000:3.0:1788851100.379498:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000833024 00000100:00100000:3.0:1788851100.379565:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 236 00000100:00100000:3.0:1788851100.379576:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+31:11675:x1875746000833024:12345-192.168.204.6@tcp:54:lfs.0 00010000:00010000:3.0:1788851100.379648:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577b24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.379667:0:5861:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.379681:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.379709:0:5861:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577b24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.379729:0:5861:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577b24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.379737:0:5861:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.379744:0:5861:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851100.379749:0:5861:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577b24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.379758:0:5861:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577b24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.379798:0:5861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:3.0:1788851100.379802:0:5861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788851100.379808:0:5861:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577b24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851100.379816:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b814a4a00/0x7ad3e1a879577b24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5861 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851100.379901:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+31:11675:x1875746000833024:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 327us (5352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851100.379909:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 236 00010000:00010000:0.0:1788851100.434894:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851100.524422:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851100.524922:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000833152 00000100:00100000:2.0:1788851100.524933:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000833152 00000100:00100000:2.0:1788851100.525054:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 71 00000100:00100000:2.0:1788851100.525065:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000833152:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:2.0:1788851100.525086:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851100.525108:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577b2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee49 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788851100.525138:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9fb399, atime: 0x6a9fb398, ctime: 0x6a9fb399, blocks: 0xb 00010000:00010000:2.0:1788851100.525176:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=433s v=(0 0) 00010000:00010000:2.0:1788851100.525181:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851100.525193:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577b2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee49 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.525943:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577b2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee49 expref: 8 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851100.526009:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546400, rc 0) 00000100:00100000:2.0:1788851100.526082:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2353:x1875746000833152:12345-192.168.204.6@tcp:101:cat.0 Request processed in 1019us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851100.526090:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 71 00000100:00080000:0.0:1788851100.526488:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851100.531461:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851100.531827:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000833280 00000100:00100000:2.0:1788851100.531838:0:6713:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000833280 00002000:00100000:2.0:1788851100.531891:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8a9bb3c1c000 x1875746000833280/t0(0) o3->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:166/0 lens 488/0 e 0 to 0 dl 1788851111 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788851100.531904:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bb3c1c000 with x1875746000833280 ext(0->4095) 00002000:00010000:2.0:1788851100.531910:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bb3c1c000 00000100:00100000:2.0:1788851100.531940:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:2.0:1788851100.531949:0:6713:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2352:x1875746000833280:12345-192.168.204.6@tcp:3:cat.0 00000100:00100000:2.0:1788851100.532573:0:6713:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2352:x1875746000833280:12345-192.168.204.6@tcp:3:cat.0 Request processed in 621us (1120us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788851100.532582:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00002000:00100000:2.0:1788851100.532590:0:6713:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8a9bb3c1c000 x1875746000833280/t0(0) o3->3c328062-9d4c-41e6-ae57-f4af3bf37898@192.168.204.6@tcp:166/0 lens 488/4536 e 0 to 0 dl 1788851111 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788851100.532622:0:6713:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8a9bb3c1c000 with x1875746000833280 ext(0->4095) 00002000:00010000:2.0:1788851100.532626:0:6713:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8a9bb3c1c000 00010000:00010000:3.0:1788851101.458966:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851101.714076:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019688704:0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.714153:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851101.714208:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019689216:0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.714250:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851101.714281:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788851101.714287:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019688576:0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.714315:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851101.714338:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3c1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019689088:0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.714360:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851101.714385:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019688832:0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.714408:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851101.714425:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851101.714430:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019688960:0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.714449:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851101.714483:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019688704 00000100:00100000:3.0:1788851101.714491:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019688704 00000100:00100000:3.0:1788851101.714539:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689088 00000100:00100000:3.0:1788851101.714542:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689088 00000100:00100000:3.0:1788851101.714562:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019688832 00000100:00100000:3.0:1788851101.714564:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019688832 00000100:00100000:3.0:1788851101.714586:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788851101.714594:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019688704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.714647:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4132d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019688704:12345-0@lo:400:kworker.0 Request processed in 53us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851101.714654:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788851101.714671:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788851101.714677:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019689088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.714702:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019689088:12345-0@lo:400:kworker.0 Request processed in 26us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851101.714707:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788851101.714728:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788851101.714734:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019688832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.714779:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019688832:12345-0@lo:400:kworker.0 Request processed in 45us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851101.714807:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788851101.714827:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019688576 00000100:00100000:3.0:1788851101.714830:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019688576 00000100:00100000:3.0:1788851101.714856:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1788851101.714863:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019688576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.714893:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019688576:12345-0@lo:400:kworker.0 Request processed in 30us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851101.714898:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:3.0:1788851101.714931:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851101.714967:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019688832:0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.714991:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3c1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019688576:0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.715000:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3c1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019689088:0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.715008:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019688704:0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.715045:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689216 00000100:00100000:3.0:1788851101.715048:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689216 00000100:00100000:3.0:1788851101.715077:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019688960 00000100:00100000:3.0:1788851101.715081:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019688960 00000100:00100000:3.0:1788851101.715098:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788851101.715104:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1875746019689216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.715138:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1875746019689216:12345-0@lo:400:kworker.0 Request processed in 34us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851101.715154:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788851101.715167:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788851101.715173:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875746019688960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.715204:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875746019688960:12345-0@lo:400:kworker.0 Request processed in 32us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851101.715210:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788851101.715226:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788851101.715229:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851101.715245:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019688960:0@lo:400:kworker.0 00000100:00100000:3.0:1788851101.715266:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019689216:0@lo:400:kworker.0 00000100:00100000:0.0:1788851101.718074:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851101.718099:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019689344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851101.718170:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851101.718218:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689344 00000100:00100000:0.0:1788851101.718228:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689344 00000100:00100000:0.0:1788851101.718276:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788851101.718286:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875746019689344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851101.718324:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788851101.718368:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875746019689344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851101.718375:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788851101.718421:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019689344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851102.227307:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788851102.227337:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019689472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851102.227438:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851102.227605:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689472 00000100:00100000:3.0:1788851102.227616:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689472 00000100:00100000:3.0:1788851102.227682:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788851102.227694:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875746019689472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851102.227745:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851102.227828:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875746019689472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851102.227836:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788851102.231091:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4133b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019689472:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788851102.346081:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:2.0:1788851102.485623:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851103.516022:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851103.752437:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851103.752493:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851103.752529:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851103.752558:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851103.752583:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851103.752611:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000833920 00000100:00100000:3.0:1788851103.752642:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000833920 00000100:00100000:3.0:1788851103.752713:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000833536 00000100:00100000:3.0:1788851103.752717:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000833536 00000100:00100000:3.0:1788851103.752746:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 172 00000100:00100000:3.0:1788851103.752757:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2352:x1875746000833920:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851103.752877:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2352:x1875746000833920:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 121us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851103.752885:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 172 00000100:00100000:3.0:1788851103.752902:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 173 00000100:00100000:3.0:1788851103.752909:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+31:2352:x1875746000833536:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851103.752941:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+31:2352:x1875746000833536:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 32us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851103.752947:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 173 00000100:00100000:3.0:1788851103.752969:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000833664 00000100:00100000:3.0:1788851103.752972:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000833664 00000100:00100000:3.0:1788851103.752996:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000833792 00000100:00100000:3.0:1788851103.752999:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000833792 00000100:00100000:3.0:1788851103.753018:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 89 00000100:00100000:3.0:1788851103.753025:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2352:x1875746000833664:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851103.753051:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4133b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2352:x1875746000833664:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 27us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851103.753058:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 89 00000100:00100000:1.0:1788851103.753426:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 90 00000100:00100000:1.0:1788851103.753438:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2352:x1875746000833792:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851103.753483:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+8:2352:x1875746000833792:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 49us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851103.753490:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 90 00000100:00100000:0.0:1788851103.753603:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000833408 00000100:00100000:0.0:1788851103.753609:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000833408 00000100:00100000:0.0:1788851103.753649:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 304 00000100:00100000:0.0:1788851103.753656:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2352:x1875746000833408:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851103.753695:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2352:x1875746000833408:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 39us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851103.753713:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 304 00000100:00080000:3.0:1788851103.754002:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788851103.754007:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788851103.754010:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788851103.856580:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000020:00080000:3.0:1788851103.856612:0:5883:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8a9b8be34000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788851103.856636:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9bbcfb0400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8a9b8be343c0 00000020:00080000:3.0:1788851103.856640:0:5883:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8a9bbcfb0600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8a9baf539000 00000020:00080000:3.0:1788851103.856664:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1788851103.856672:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788851103.856756:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788851103.857016:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1788851104.382767:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1788851104.383344:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:3.0:1788851104.530265:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851105.554389:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851106.463134:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851106.463314:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000834048 00000100:00100000:3.0:1788851106.463326:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000834048 00000100:00100000:3.0:1788851106.463410:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 237 00000100:00100000:3.0:1788851106.463425:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:11336:x1875746000834048:12345-192.168.204.6@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788851106.463549:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:11336:x1875746000834048:12345-192.168.204.6@tcp:60:lhsmtool_posix.0 Request processed in 128us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851106.463558:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 237 00000100:00080000:0.0:1788851106.463624:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851106.475985:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851106.477399:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000834304 00000100:00100000:2.0:1788851106.477415:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000834304 00000100:00100000:2.0:1788851106.477488:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 65 00000100:00100000:2.0:1788851106.477498:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:11336:x1875746000834304:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788851106.478347:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:11336:x1875746000834304:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 845us (2368us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788851106.478360:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 65 00010000:00010000:0.0:1788851106.579329:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851106.837554:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019689600:0@lo:400:kworker.0 00000100:00100000:2.0:1788851106.837658:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851106.837718:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019690112:0@lo:400:kworker.0 00000100:00100000:2.0:1788851106.837747:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851106.837776:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788851106.837800:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019689728:0@lo:400:kworker.0 00000100:00100000:0.0:1788851106.837967:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019689856:0@lo:400:kworker.0 00000100:00100000:3.0:1788851106.838040:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019690112 00000100:00100000:3.0:1788851106.838051:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019690112 00000100:00100000:3.0:1788851106.838125:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788851106.838134:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019690112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851106.838205:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689600 00000100:00100000:1.0:1788851106.838210:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689600 00000100:00100000:1.0:1788851106.838236:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788851106.838243:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019689600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851106.844758:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851106.844851:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851106.844866:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019689984:0@lo:400:kworker.0 00000100:00100000:0.0:1788851106.844905:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851106.845395:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689984 00000100:00100000:0.0:1788851106.845406:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689984 00000100:00100000:0.0:1788851106.845475:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788851106.845486:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019689984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851106.845572:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019689984:12345-0@lo:400:kworker.0 Request processed in 88us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851106.845579:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788851106.845625:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788851106.845632:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a9b8bcf0e00, transno 4294967310 00000100:00100000:0.0:1788851106.845657:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019689984:0@lo:400:kworker.0 00000100:00080000:0.0:1788851106.846069:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851106.846075:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851106.846434:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689856 00000100:00100000:0.0:1788851106.846441:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689856 00000100:00100000:0.0:1788851106.846505:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788851106.846659:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019689856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851106.846825:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019689856:12345-0@lo:400:kworker.0 Request processed in 312us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851106.846833:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788851106.846898:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019690368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851106.846934:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851106.846980:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019689856:0@lo:400:kworker.0 00000100:00080000:0.0:1788851106.847009:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851106.847050:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019690368 00000100:00100000:0.0:1788851106.847054:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019690368 00000100:00100000:0.0:1788851106.847096:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788851106.847115:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019690368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851106.847147:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788851106.847187:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019690368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851106.847193:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788851106.847216:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1788851106.847222:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8a9bafcf9f80, transno 4294967322 00000004:00080000:0.0:1788851106.847232:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1788851106.847253:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019690368:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788851106.847530:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851106.848052:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851106.848343:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b98daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019690240:0@lo:400:kworker.0 00000100:00100000:2.0:1788851106.848391:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851106.848418:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019690240 00000100:00100000:2.0:1788851106.848424:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019690240 00000100:00100000:2.0:1788851106.848460:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788851106.848469:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019690240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851106.848508:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c26300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019690240:12345-0@lo:400:kworker.0 Request processed in 41us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851106.848514:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788851106.848546:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98daed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019690240:0@lo:400:kworker.0 00000100:00100000:0.0:1788851106.848630:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019689728 00000100:00100000:0.0:1788851106.848635:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019689728 00000100:00100000:0.0:1788851106.848676:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788851106.848683:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019689728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851106.848728:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019689728:12345-0@lo:400:kworker.0 Request processed in 46us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851106.848734:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788851106.848824:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019689728:0@lo:400:kworker.0 00000100:00100000:3.0:1788851106.850705:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019690112:12345-0@lo:400:kworker.0 Request processed in 12562us (12945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851106.850723:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788851106.850869:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b98dad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019690112:0@lo:400:kworker.0 00000100:00100000:1.0:1788851106.852179:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019689600:12345-0@lo:400:kworker.0 Request processed in 13930us (14515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851106.852193:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788851106.858034:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019689600:0@lo:400:kworker.0 00000100:00100000:0.0:1788851107.346099:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019690496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851107.346188:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851107.346250:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019690496 00000100:00100000:3.0:1788851107.346259:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019690496 00000100:00100000:3.0:1788851107.346312:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788851107.346323:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baef3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019690496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851107.346363:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851107.346425:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baef3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019690496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851107.346458:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788851107.346550:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3c1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019690496:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788851107.603589:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788851108.242321:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788851108.242331:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788851108.242662:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788851108.242669:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788851108.626147:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788851108.858830:0:12787:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 03:05:06 (1788851106) 00000100:00100000:3.0:1788851108.865441:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851108.865492:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851108.865517:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851108.865616:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000834432 00000100:00100000:0.0:1788851108.865627:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000834432 00000100:00100000:0.0:1788851108.865691:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 306 00000100:00100000:0.0:1788851108.865703:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2351:x1875746000834432:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851108.865735:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000834688 00000100:00100000:1.0:1788851108.865742:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000834688 00000100:00100000:0.0:1788851108.865821:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6835cbef-1345-4ac2-988d-7ad135109255+13:2351:x1875746000834432:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 120us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851108.865831:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 306 00000100:00100000:1.0:1788851108.865835:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 93 00000100:00100000:1.0:1788851108.865866:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2351:x1875746000834688:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851108.865912:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2351:x1875746000834688:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 51us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851108.865920:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 93 00000100:00080000:1.0:1788851108.865941:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851108.866506:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851108.866554:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851108.866578:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000834816 00000100:00100000:3.0:1788851108.866583:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000834816 00000100:00100000:3.0:1788851108.866631:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 94 00000100:00100000:3.0:1788851108.866641:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2351:x1875746000834816:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851108.866649:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000834944 00000100:00100000:0.0:1788851108.866655:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000834944 00000100:00100000:3.0:1788851108.866687:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2351:x1875746000834816:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 48us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851108.866693:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000834560 00000100:00100000:3.0:1788851108.866696:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 94 00000100:00100000:0.0:1788851108.866698:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000834560 00000100:00100000:0.0:1788851108.866735:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 177 00000100:00100000:3.0:1788851108.866743:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 178 00000100:00100000:0.0:1788851108.866745:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2351:x1875746000834944:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851108.866757:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc18c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:2351:x1875746000834560:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851108.866824:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:2351:x1875746000834944:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 39us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851108.866831:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 177 00000100:00100000:3.0:1788851108.866986:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc18c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:2351:x1875746000834560:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 232us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851108.866993:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 178 00000100:00080000:1.0:1788851108.870638:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788851108.870650:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:1.0:1788851109.041086:0:5883:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1788851109.041276:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788851109.041350:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788851109.041362:0:5894:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1788851109.650068:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851110.674987:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851111.700161:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851111.756588:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851111.756717:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000835072 00000100:00100000:0.0:1788851111.756732:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000835072 00000100:00100000:0.0:1788851111.756877:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 238 00000100:00100000:0.0:1788851111.756910:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+5:12339:x1875746000835072:12345-192.168.204.6@tcp:101:lsof.0 00010000:00010000:0.0:1788851111.756939:0:5862:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851111.756968:0:5862:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577b32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee50 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851111.757064:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577b39 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851111.757081:0:5862:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577b39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851111.757094:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577b39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851111.757140:0:5862:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788851111.757145:0:5862:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788851111.757194:0:5862:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577b39 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5862 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851111.757223:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7c00/0x7ad3e1a879577b32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee50 expref: 7 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851111.757246:0:5862:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577b39 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee50 expref: 6 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851111.757255:0:5862:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b87c2ab00) 00010000:00010000:0.0:1788851111.757258:0:5862:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851111.757261:0:5862:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6a00, rc 0) 00000100:00100000:0.0:1788851111.757344:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:37963b51-fe0d-42c0-b479-a7af644fd745+6:12339:x1875746000835072:12345-192.168.204.6@tcp:101:lsof.0 Request processed in 439us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851111.757361:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 238 00000100:00080000:1.0:1788851111.758012:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851111.954119:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019691008:0@lo:400:kworker.0 00000100:00100000:0.0:1788851111.954215:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851111.954291:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788851111.954298:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875746019690880:0@lo:400:kworker.0 00000100:00100000:0.0:1788851111.954327:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851111.954369:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019690880 00000100:00100000:0.0:1788851111.954380:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019690880 00000100:00100000:0.0:1788851111.954449:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788851111.954459:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875746019690880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851111.954653:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019690624:0@lo:400:kworker.0 00000100:00100000:2.0:1788851111.954694:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851111.954717:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019691136:0@lo:400:kworker.0 00000100:00100000:2.0:1788851111.954740:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851111.954759:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788851111.954765:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baef3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019690752:0@lo:400:kworker.0 00000100:00100000:2.0:1788851111.954824:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851111.954843:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019691264:0@lo:400:kworker.0 00000100:00100000:2.0:1788851111.954864:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851111.954877:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691136 00000100:00100000:3.0:1788851111.954882:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691136 00000100:00100000:2.0:1788851111.954887:0:5862:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019690752 00000100:00100000:2.0:1788851111.954890:0:5862:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019690752 00000100:00100000:1.0:1788851111.954964:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019691392:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851111.954997:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851111.955036:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691008 00000100:00100000:1.0:1788851111.955040:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691008 00000100:00100000:1.0:1788851111.955083:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691264 00000100:00100000:1.0:1788851111.955086:0:6707:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691264 00000100:00100000:1.0:1788851111.955109:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788851111.955117:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019691008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851111.955153:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019691008:12345-0@lo:400:kworker.0 Request processed in 38us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851111.955161:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788851111.955181:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788851111.955187:0:6707:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019691264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851111.955221:0:6707:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019691264:12345-0@lo:400:kworker.0 Request processed in 34us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851111.955226:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788851111.955267:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019690624 00000100:00100000:1.0:1788851111.955279:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019690624 00000100:00100000:1.0:1788851111.955319:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788851111.955332:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019690624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851111.955367:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3310:x1875746019690624:12345-0@lo:400:kworker.0 Request processed in 39us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851111.955372:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1788851111.955407:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691392 00000100:00100000:1.0:1788851111.955410:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691392 00000100:00100000:1.0:1788851111.955433:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788851111.955440:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019691392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788851111.955475:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851111.955511:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019691392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851111.955516:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788851111.955581:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00080000:1.0:1788851111.955690:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851111.955696:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788851111.955699:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788851111.955917:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875746019690880:12345-0@lo:400:kworker.0 Request processed in 64us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851111.955925:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788851111.955989:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875746019690880:0@lo:400:kworker.0 00000100:00100000:0.0:1788851111.956003:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019691008:0@lo:400:kworker.0 00000100:00100000:0.0:1788851111.956065:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019691264:0@lo:400:kworker.0 00000100:00100000:0.0:1788851111.956076:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019690624:0@lo:400:kworker.0 00000100:00100000:0.0:1788851111.956121:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019691392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851111.956172:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788851111.956180:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019690752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851111.956299:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019690752:12345-0@lo:400:kworker.0 Request processed in 118us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851111.956305:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788851111.959449:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019691136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851111.959617:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019691136:12345-0@lo:400:kworker.0 Request processed in 4028us (4875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851111.959629:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788851111.969528:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baef3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019690752:0@lo:400:kworker.0 00000100:00100000:0.0:1788851111.969567:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019691136:0@lo:400:kworker.0 00000100:00100000:0.0:1788851112.467601:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019691520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851112.467722:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851112.467895:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691520 00000100:00100000:1.0:1788851112.467907:0:6708:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691520 00000100:00100000:1.0:1788851112.467978:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788851112.467989:0:6708:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019691520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851112.468215:0:6708:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851112.468284:0:6708:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019691520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 296us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851112.468291:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788851112.468385:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019691520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788851112.724072:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851113.746399:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851113.991221:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851113.991289:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851113.991349:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851113.991372:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851113.991413:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851113.991457:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000835456 00000100:00100000:1.0:1788851113.991470:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000835456 00000100:00100000:1.0:1788851113.991570:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000835584 00000100:00100000:1.0:1788851113.991574:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000835584 00000100:00100000:1.0:1788851113.991606:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 97 00000100:00100000:1.0:1788851113.991618:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000835456:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851113.991727:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98daf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2353:x1875746000835456:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 112us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851113.991737:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 97 00000100:00100000:1.0:1788851113.991758:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 98 00000100:00100000:1.0:1788851113.991766:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98daed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000835584:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851113.991834:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98daed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2353:x1875746000835584:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 68us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851113.991841:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 98 00000100:00080000:1.0:1788851113.991987:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851113.991991:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851113.992158:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000835200 00000100:00100000:2.0:1788851113.992164:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000835200 00000100:00100000:2.0:1788851113.992207:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 308 00000100:00100000:2.0:1788851113.992216:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000835200:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788851113.992255:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6835cbef-1345-4ac2-988d-7ad135109255+13:2353:x1875746000835200:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 41us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851113.992262:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 308 00000100:00100000:0.0:1788851113.992363:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000835712 00000100:00100000:0.0:1788851113.992369:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000835712 00000100:00100000:0.0:1788851113.992423:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 182 00000100:00100000:0.0:1788851113.992432:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37963b51-fe0d-42c0-b479-a7af644fd745+6:2353:x1875746000835712:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851113.992466:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:37963b51-fe0d-42c0-b479-a7af644fd745+6:2353:x1875746000835712:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 37us (1117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851113.992472:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 182 00000100:00100000:0.0:1788851113.992487:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000835328 00000100:00100000:0.0:1788851113.992491:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000835328 00000100:00100000:0.0:1788851113.992524:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 183 00000100:00100000:0.0:1788851113.992531:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b98dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:2353:x1875746000835328:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851113.992556:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b98dad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:2353:x1875746000835328:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 26us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851113.992562:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 183 00000100:00080000:2.0:1788851113.992655:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851114.327920:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851114.328107:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000835968 00000100:00100000:2.0:1788851114.328121:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000835968 00000100:00100000:2.0:1788851114.328197:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 66 00000100:00100000:2.0:1788851114.328208:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+18:12341:x1875746000835968:12345-192.168.204.6@tcp:35:umount.0 00000100:00100000:2.0:1788851114.328920:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:12341:x1875746000835968:12345-192.168.204.6@tcp:35:umount.0 Request processed in 709us (1013us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788851114.328935:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 66 00000100:00100000:3.0:1788851114.337027:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851114.339876:0:5865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000836224 00000100:00100000:2.0:1788851114.339901:0:5865:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000836224 00000100:00100000:2.0:1788851114.340005:0:5865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 67 00000100:00100000:2.0:1788851114.340018:0:5865:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+19:12341:x1875746000836224:12345-192.168.204.6@tcp:35:umount.0 00000100:00100000:2.0:1788851114.340476:0:5865:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+20:12341:x1875746000836224:12345-192.168.204.6@tcp:35:umount.0 Request processed in 458us (3457us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788851114.340485:0:5865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 67 00000100:00100000:3.0:1788851114.348277:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851114.348695:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000836480 00000100:00100000:1.0:1788851114.348706:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000836480 00000100:00100000:1.0:1788851114.348768:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:1.0:1788851114.348778:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b912a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+20:12341:x1875746000836480:12345-192.168.204.6@tcp:35:umount.0 00000100:00100000:1.0:1788851114.349122:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b912a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:12341:x1875746000836480:12345-192.168.204.6@tcp:35:umount.0 Request processed in 344us (856us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788851114.349149:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 68 00000100:00100000:3.0:1788851114.353218:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851114.353337:0:5864:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000836736 00000100:00100000:0.0:1788851114.353349:0:5864:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000836736 00000100:00100000:0.0:1788851114.353417:0:5864:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:0.0:1788851114.353439:0:5864:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:12341:x1875746000836736:12345-192.168.204.6@tcp:35:umount.0 00000100:00100000:0.0:1788851114.353898:0:5864:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:12341:x1875746000836736:12345-192.168.204.6@tcp:35:umount.0 Request processed in 471us (690us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788851114.353907:0:5864:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 69 00000100:00100000:3.0:1788851114.365623:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851114.365680:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851114.366652:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000836992 00000100:00100000:0.0:1788851114.366673:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000836992 00000100:00100000:0.0:1788851114.366836:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000837120 00000100:00100000:0.0:1788851114.366840:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000837120 00000100:00100000:0.0:1788851114.366885:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:0.0:1788851114.366899:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b906b7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6835cbef-1345-4ac2-988d-7ad135109255+14:2354:x1875746000836992:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851114.366921:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851114.366952:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a5a00/0x7ad3e1a879576b25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9aa expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851114.366979:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851114.367072:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b906b7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6835cbef-1345-4ac2-988d-7ad135109255+13:2354:x1875746000836992:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 175us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851114.367080:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:0.0:1788851114.367151:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:0.0:1788851114.367159:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6835cbef-1345-4ac2-988d-7ad135109255+12:2354:x1875746000837120:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851114.367167:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851114.367177:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b90547e00/0x7ad3e1a879576dc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaad expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851114.367187:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851114.367205:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6835cbef-1345-4ac2-988d-7ad135109255+11:2354:x1875746000837120:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 46us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851114.367212:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:1.0:1788851114.377071:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851114.377962:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000836864 00000100:00100000:0.0:1788851114.377981:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000836864 00000100:00100000:0.0:1788851114.378076:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:0.0:1788851114.378089:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99171880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6835cbef-1345-4ac2-988d-7ad135109255+11:2352:x1875746000836864:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851114.378112:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851114.378153:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a5800/0x7ad3e1a879576bbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9e2 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851114.378179:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851114.378256:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99171880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6835cbef-1345-4ac2-988d-7ad135109255+10:2352:x1875746000836864:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 170us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851114.378264:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:2.0:1788851114.381882:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851114.384306:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000837504 00000100:00100000:0.0:1788851114.384507:0:6706:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000837504 00000100:00100000:0.0:1788851114.384585:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 72 00000100:00100000:0.0:1788851114.384596:0:6706:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+7:2350:x1875746000837504:12345-192.168.204.6@tcp:9:umount.0 00000020:00000080:0.0:1788851114.384857:0:6706:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a8795770f8 00000020:00010000:0.0:1788851114.384870:0:6706:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a9bb4016800: total 0 00000100:00080000:0.0:1788851114.384875:0:6706:0:(import.c:65:import_set_state_nolock()) ffff8a9bb4014000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788851114.384914:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:2.0:1788851114.385035:0:5850:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a9bb4016800: total 0 00010000:00010000:2.0:1788851114.385076:0:5850:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a9bb4016800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788851114.385136:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa9e6a9c/0x7ad3e1a879577b2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee49 expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.385185:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d898dd74/0x7ad3e1a87957749b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec82 expref: 5 pid: 8281 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851114.385200:0:5850:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a9bb4016800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788851114.385212:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851114.385214:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851114.385216:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851114.389578:0:6706:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3c328062-9d4c-41e6-ae57-f4af3bf37898+2:2350:x1875746000837504:12345-192.168.204.6@tcp:9:umount.0 Request processed in 4970us (7695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851114.389595:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 72 00000100:00100000:2.0:1788851114.396561:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851114.396655:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000837632 00000100:00100000:1.0:1788851114.396667:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000837632 00000100:00100000:1.0:1788851114.397004:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00100000:1.0:1788851114.397019:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+5:2350:x1875746000837632:12345-192.168.204.6@tcp:9:umount.0 00000020:00000080:1.0:1788851114.397057:0:8281:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576e97 00000100:00080000:1.0:1788851114.397069:0:8281:0:(import.c:65:import_set_state_nolock()) ffff8a9bb42c3800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788851114.397110:0:8281:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1788851114.397590:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851114.397643:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+2:2350:x1875746000837632:12345-192.168.204.6@tcp:9:umount.0 Request processed in 625us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851114.397652:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 73 00000100:00100000:2.0:1788851114.416683:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851114.416815:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000838656 00000100:00100000:0.0:1788851114.416825:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000838656 00000100:00100000:0.0:1788851114.416886:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 239 00000100:00100000:0.0:1788851114.416896:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+22:2350:x1875746000838656:12345-192.168.204.6@tcp:39:umount.0 00000020:00000080:0.0:1788851114.416937:0:8079:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576b33 00000020:00010000:0.0:1788851114.416955:0:8079:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a9b8675a800: total 0 00000100:00080000:0.0:1788851114.416961:0:8079:0:(import.c:65:import_set_state_nolock()) ffff8a9bb44b2000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788851114.416994:0:8079:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1788851114.417725:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3c328062-9d4c-41e6-ae57-f4af3bf37898+21:2350:x1875746000838656:12345-192.168.204.6@tcp:39:umount.0 Request processed in 826us (1049us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788851114.417754:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 239 00000020:00010000:3.0:1788851114.418091:0:7644:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a9b8675a800: total 0 00010000:00010000:3.0:1788851114.418144:0:7644:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a9b8675a800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788851114.418189:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851114.418194:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851114.418204:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547a00/0x7ad3e1a87957745c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec6d expref: 20 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851114.418224:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851114.418227:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788851114.418231:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e600/0x7ad3e1a879577486 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec7b expref: 19 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851114.418244:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b87c2ab00) 00010000:00010000:3.0:1788851114.418247:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851114.418251:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168fa00/0x7ad3e1a8795774ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec97 expref: 18 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851114.418283:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:3.0:1788851114.418286:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788851114.418290:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90546c00/0x7ad3e1a87957715a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeba9 expref: 17 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851114.418303:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a9ba0794100) 00010000:00010000:3.0:1788851114.418306:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851114.418309:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879576dfd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeabb expref: 16 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851114.418624:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:3.0:1788851114.418627:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851114.418632:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6c00/0x7ad3e1a879577aec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee34 expref: 15 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851114.418648:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8a9b87c2af00) 00010000:00010000:3.0:1788851114.418650:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788851114.418653:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879576e6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfead7 expref: 14 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851114.418668:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:3.0:1788851114.418671:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788851114.418674:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879577b16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee42 expref: 13 pid: 8079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851114.418686:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8a9b9199ae00) 00010000:00010000:3.0:1788851114.418689:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788851114.418699:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58a00/0x7ad3e1a87957737c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec35 expref: 12 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851114.418717:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a9bbcd02f00) 00010000:00010000:3.0:1788851114.418720:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851114.418723:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b90547000/0x7ad3e1a879576e19 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeac2 expref: 11 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851114.418737:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:3.0:1788851114.418739:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788851114.418743:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7e00/0x7ad3e1a8795777ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfed70 expref: 10 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851114.418755:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8a9ba0794c00) 00010000:00010000:3.0:1788851114.418757:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788851114.418760:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577a0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfedfc expref: 9 pid: 5863 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851114.418772:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8a9b9199a200) 00010000:00010000:3.0:1788851114.418774:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788851114.418778:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59c00/0x7ad3e1a87957750b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfec9e expref: 8 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851114.418844:0:7644:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a9b8675a800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788851114.418864:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851114.418866:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851114.418868:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788851114.618513:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3c328062-9d4c-41e6-ae57-f4af3bf37898 00000020:00000080:1.0:1788851114.618522:0:7656:0:(genops.c:885:class_export_put()) final put ffff8a9bb4016800/3c328062-9d4c-41e6-ae57-f4af3bf37898 00000020:00000080:0.0:1788851114.618751:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb4016800/3c328062-9d4c-41e6-ae57-f4af3bf37898 for lustre-OST0001 00000020:00000080:0.0:1788851114.619098:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9bb4014000 for lustre-OST0001 00010000:00010000:2.0:1788851114.770038:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851115.794126:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851116.818404:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851117.075181:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019691776:0@lo:400:kworker.0 00000100:00100000:1.0:1788851117.075259:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851117.075466:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019692288:0@lo:400:kworker.0 00000100:00100000:1.0:1788851117.075497:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851117.075524:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788851117.075531:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019691648:0@lo:400:kworker.0 00000100:00100000:1.0:1788851117.075562:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851117.075580:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692288 00000100:00100000:1.0:1788851117.075590:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019692160:0@lo:400:kworker.0 00000100:00100000:3.0:1788851117.075602:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692288 00000100:00100000:1.0:1788851117.075617:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851117.075650:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019691904:0@lo:400:kworker.0 00000100:00100000:3.0:1788851117.075667:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788851117.075681:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019692288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851117.075705:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851117.075730:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851117.075735:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019692032:0@lo:400:kworker.0 00000100:00100000:1.0:1788851117.075761:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851117.075809:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691648 00000100:00100000:1.0:1788851117.075813:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691648 00000100:00100000:1.0:1788851117.075843:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788851117.075850:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019691648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851117.075887:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019691648:12345-0@lo:400:kworker.0 Request processed in 37us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851117.075894:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788851117.075925:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691776 00000100:00100000:1.0:1788851117.075928:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691776 00000100:00100000:1.0:1788851117.075952:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692160 00000100:00100000:1.0:1788851117.075954:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692160 00000100:00100000:1.0:1788851117.075968:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019691904 00000100:00100000:1.0:1788851117.075970:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019691904 00000100:00100000:1.0:1788851117.075984:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788851117.076003:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019691776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851117.076164:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788851117.076174:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019692160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851117.081008:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99172a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019692288:12345-0@lo:400:kworker.0 Request processed in 5321us (5499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851117.081090:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788851117.081122:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692032 00000100:00100000:3.0:1788851117.081130:0:6704:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692032 00000100:00100000:3.0:1788851117.081187:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788851117.081197:0:6704:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019692032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851117.081270:0:6704:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019692032:12345-0@lo:400:kworker.0 Request processed in 76us (5508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851117.081276:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1788851117.081712:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788851117.081718:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788851117.081722:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851117.082338:0:5863:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788851117.082353:0:5863:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788851117.083299:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019692160:12345-0@lo:400:kworker.0 Request processed in 7125us (7680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851117.083312:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788851117.083344:0:5862:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788851117.083355:0:5862:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019691904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851117.083607:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019691648:0@lo:400:kworker.0 00000100:00100000:3.0:1788851117.083635:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019692160:0@lo:400:kworker.0 00000100:00100000:3.0:1788851117.083649:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019692288:0@lo:400:kworker.0 00000100:00100000:0.0:1788851117.087603:0:5862:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019691904:12345-0@lo:400:kworker.0 Request processed in 4241us (11903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851117.087619:0:5862:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788851117.087736:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019692032:0@lo:400:kworker.0 00000100:00100000:0.0:1788851117.087750:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019691904:0@lo:400:kworker.0 00000100:00100000:1.0:1788851117.089287:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019691776:12345-0@lo:400:kworker.0 Request processed in 13279us (14011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851117.089300:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788851117.089354:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019691776:0@lo:400:kworker.0 00000100:00100000:0.0:1788851117.091638:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019692416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851117.091742:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851117.092001:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692416 00000100:00100000:3.0:1788851117.092010:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692416 00000100:00100000:3.0:1788851117.092074:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788851117.092085:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019692416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788851117.092127:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851117.092179:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019692416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851117.092205:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788851117.094239:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019692416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851117.408523:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851117.408576:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851117.409589:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000838784 00000100:00100000:1.0:1788851117.409601:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000838784 00000100:00100000:1.0:1788851117.409678:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000838912 00000100:00100000:1.0:1788851117.409682:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000838912 00000100:00100000:1.0:1788851117.409722:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:1.0:1788851117.409751:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6835cbef-1345-4ac2-988d-7ad135109255+11:2351:x1875746000838784:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851117.409771:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851117.409822:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9baef58600/0x7ad3e1a879576c05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9f7 expref: 11 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.409843:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851117.409899:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6835cbef-1345-4ac2-988d-7ad135109255+10:2351:x1875746000838784:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 151us (1387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851117.409906:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:1.0:1788851117.409924:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:1.0:1788851117.409931:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6835cbef-1345-4ac2-988d-7ad135109255+9:2351:x1875746000838912:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851117.409939:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851117.409947:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9baef59400/0x7ad3e1a879576c0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfea21 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.409957:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851117.409975:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c25f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6835cbef-1345-4ac2-988d-7ad135109255+8:2351:x1875746000838912:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 44us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851117.409982:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:1.0:1788851117.429029:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851117.429144:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000839040 00000100:00100000:3.0:1788851117.429154:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000839040 00000100:00100000:3.0:1788851117.429294:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:3.0:1788851117.429306:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6835cbef-1345-4ac2-988d-7ad135109255+8:2351:x1875746000839040:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788851117.429324:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851117.429481:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b90547800/0x7ad3e1a879576da2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeaa6 expref: 8 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851117.429500:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851117.429597:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6835cbef-1345-4ac2-988d-7ad135109255+7:2351:x1875746000839040:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 292us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851117.429605:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:2.0:1788851117.452574:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851117.452714:0:5863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000839296 00000100:00100000:3.0:1788851117.452726:0:5863:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000839296 00000100:00100000:3.0:1788851117.452831:0:5863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 240 00000100:00100000:3.0:1788851117.452841:0:5863:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+6:2350:x1875746000839296:12345-192.168.204.6@tcp:39:umount.0 00000020:00000080:3.0:1788851117.452893:0:5863:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576c1a 00000020:00010000:3.0:1788851117.452902:0:5863:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a9b8da6a000: total 0 00000100:00080000:3.0:1788851117.452907:0:5863:0:(import.c:65:import_set_state_nolock()) ffff8a9b8da69800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788851117.452942:0:5863:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1788851117.453167:0:5850:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a9b8da6a000: total 0 00010000:00010000:1.0:1788851117.453172:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851117.453206:0:5863:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:37963b51-fe0d-42c0-b479-a7af644fd745+5:2350:x1875746000839296:12345-192.168.204.6@tcp:39:umount.0 Request processed in 365us (642us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788851117.453215:0:5863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 240 00010000:00010000:1.0:1788851117.453232:0:5850:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a9b8da6a000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788851117.453279:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b87c2ab00) 00010000:00010000:1.0:1788851117.453284:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788851117.453295:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6a00/0x7ad3e1a879577b39 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee50 expref: 4 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851117.453340:0:5850:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a9b8da6a000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788851117.453355:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851117.453357:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851117.453360:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788851117.453595:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851117.484614:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851117.484726:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000839552 00000100:00100000:1.0:1788851117.484738:0:5853:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000839552 00000100:00100000:1.0:1788851117.484833:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 310 00000100:00100000:1.0:1788851117.484844:0:5853:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bbce11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+7:2350:x1875746000839552:12345-192.168.204.6@tcp:251:umount.0 00000020:00000080:1.0:1788851117.484903:0:5853:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576b10 00000020:00010000:1.0:1788851117.484913:0:5853:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a9b8675e000: total 0 00000100:00080000:1.0:1788851117.484919:0:5853:0:(import.c:65:import_set_state_nolock()) ffff8a9bb6ff6000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788851117.484990:0:5853:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bbce11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6835cbef-1345-4ac2-988d-7ad135109255+3:2350:x1875746000839552:12345-192.168.204.6@tcp:251:umount.0 Request processed in 147us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851117.484998:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 310 00000020:00010000:0.0:1788851117.485210:0:5849:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a9b8675e000: total 0 00010000:00010000:0.0:1788851117.485255:0:5849:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a9b8675e000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788851117.485288:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a2400/0x7ad3e1a879576bc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfe9e9 expref: 2 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851117.485322:0:5849:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a9b8675e000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788851117.485332:0:5849:0:(genops.c:885:class_export_put()) final put ffff8a9b8675e000/6835cbef-1345-4ac2-988d-7ad135109255 00010000:00010000:0.0:1788851117.485351:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851117.485353:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851117.485355:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788851117.485446:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b8675e000/6835cbef-1345-4ac2-988d-7ad135109255 for MGS 00000020:00000080:1.0:1788851117.485485:0:12292:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9bb6ff6000 for MGS 00000100:00100000:3.0:1788851117.587931:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851117.587958:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019692544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851117.588055:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851117.588143:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692544 00000100:00100000:3.0:1788851117.588153:0:6709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692544 00000100:00100000:3.0:1788851117.588206:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788851117.588215:0:6709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019692544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851117.588253:0:6709:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851117.588302:0:6709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019692544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851117.588310:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788851117.588360:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019692544:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788851117.671169:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3c328062-9d4c-41e6-ae57-f4af3bf37898 00000020:00000080:0.0:1788851117.671182:0:6732:0:(genops.c:885:class_export_put()) final put ffff8a9bb42c5000/3c328062-9d4c-41e6-ae57-f4af3bf37898 00000020:00000080:1.0:1788851117.671488:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb42c5000/3c328062-9d4c-41e6-ae57-f4af3bf37898 for lustre-OST0000 00000020:00000080:1.0:1788851117.671834:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9bb42c3800 for lustre-OST0000 00010000:00010000:2.0:1788851117.842051:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851118.485711:0:11702:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788851118.485722:0:11702:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788851118.489645:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788851118.489663:0:11702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788851118.869063:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788851119.193631:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3c328062-9d4c-41e6-ae57-f4af3bf37898 00000001:00080000:0.0:1788851119.193648:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1788851119.193665:0:5883:0:(genops.c:885:class_export_put()) final put ffff8a9b8675a800/3c328062-9d4c-41e6-ae57-f4af3bf37898 00000001:00100000:0.0:1788851119.193687:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 37963b51-fe0d-42c0-b479-a7af644fd745 00000001:00080000:0.0:1788851119.193695:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788851119.193697:0:5883:0:(genops.c:885:class_export_put()) final put ffff8a9b8da6a000/37963b51-fe0d-42c0-b479-a7af644fd745 00000020:00000080:2.0:1788851119.193815:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b8675a800/3c328062-9d4c-41e6-ae57-f4af3bf37898 for lustre-MDT0000 00000020:00000080:2.0:1788851119.194013:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b8da6a000/37963b51-fe0d-42c0-b479-a7af644fd745 for lustre-MDT0000 00000020:00000080:2.0:1788851119.194053:0:12292:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9bb44b2000 for lustre-MDT0000 00000020:00000080:2.0:1788851119.194058:0:12292:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9b8da69800 for lustre-MDT0000 00000020:01000004:1.0:1788851119.787213:0:12993:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1788851119.827981:0:12993:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788851119.828039:0:12993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b9c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.828058:0:12993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576b9c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.828067:0:12993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576b9c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.828093:0:12993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576b9c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.828124:0:12993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788851119.828131:0:12993:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788851119.828162:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788851119.828167:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788851119.828175:0:12993:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788851119.828207:0:12993:0:(import.c:65:import_set_state_nolock()) ffff8a9bb3ab3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788851119.828295:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851119.828305:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576b9c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.828313:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b80030c00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788851119.828318:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576b9c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.828328:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ad3e1a879576b9c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851119.828347:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ad3e1a879576b9c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851119.828354:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851119.828356:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788851119.828358:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788851119.828402:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576b9c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851119.828407:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875746019692672:0@lo:39:umount.0 00010000:00010000:0.0:1788851119.828410:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851119.828445:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576b9c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.828453:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b80030c00/0x7ad3e1a879576b95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576b9c expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.828465:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851119.828467:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851119.828470:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851119.828489:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851119.828507:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788851119.828523:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019692800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851119.828577:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851119.828727:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692672 00000100:00100000:0.0:1788851119.828734:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692672 00000100:00100000:0.0:1788851119.828822:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788851119.828835:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875746019692672:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788851119.828865:0:8079:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a87957691f 00000100:00080000:0.0:1788851119.828876:0:8079:0:(import.c:65:import_set_state_nolock()) ffff8a9bb36a7800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788851119.828946:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3307:x1875746019692672:12345-0@lo:39:umount.0 Request processed in 114us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851119.828954:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:0.0:1788851119.828966:0:8079:0:(genops.c:885:class_export_put()) final put ffff8a9bb36a6000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788851119.829003:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb36a6000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788851119.829054:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9bb36a7800 for lustre-MDT0000 00010000:00010000:1.0:1788851119.829116:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851119.829200:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692800 00000100:00100000:2.0:1788851119.829205:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692800 00000100:00100000:2.0:1788851119.829250:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788851119.829259:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1d74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3311:x1875746019692800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851119.829271:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851119.829287:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b8168e400/0x7ad3e1a879576b9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ad3e1a879576b95 expref: 19 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851119.829300:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851119.829335:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1d74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ad19e61b-7666-4fee-85e9-385935a96ab4+18:3311:x1875746019692800:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851119.829341:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788851119.829382:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ad19e61b-7666-4fee-85e9-385935a96ab4:3311:1875746019692800:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788851119.829561:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9bb3ab3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788851119.829578:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875746019692672:0@lo:39:umount.0 00000100:00080000:1.0:1788851119.829690:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788851119.829694:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788851119.829699:0:12993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788851119.830747:0:12993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576baa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830765:0:12993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576baa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830773:0:12993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576baa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830812:0:12993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576baa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830845:0:12993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851119.830852:0:12993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576ad1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830859:0:12993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576ad1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830866:0:12993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576ad1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830872:0:12993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576ad1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830884:0:12993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788851119.830890:0:12993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576dd3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830896:0:12993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576dd3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830902:0:12993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576dd3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830908:0:12993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576dd3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830922:0:12993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788851119.830926:0:12993:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a87957687e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576885 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830937:0:12993:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a87957687e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576885 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830944:0:12993:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a87957687e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576885 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830950:0:12993:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a87957687e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576885 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851119.830957:0:12993:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788851119.830959:0:12993:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788851119.830982:0:12993:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788851119.830986:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788851119.830990:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851119.830995:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788851119.831000:0:12993:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a9bb44b6000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788851119.831005:0:12993:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8a9ba05c2800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788851119.831010:0:12993:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8a9bb45e8000) has exports, disconnecting them 00000020:00080000:1.0:1788851119.831015:0:12993:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a9bb44b6000), last request at 1788851117 00000020:00000080:1.0:1788851119.831020:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576a92 00000100:00080000:1.0:1788851119.831040:0:12993:0:(import.c:65:import_set_state_nolock()) ffff8a9bb44b1800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788851119.831085:0:12993:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a9bb44b6000): rc 0 00000020:00000080:1.0:1788851119.831088:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9bb44b6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788851119.831098:0:12993:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8a9ba05c2800), last request at 1788851117 00000020:00000080:1.0:1788851119.831100:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a8795769c7 00000100:00080000:1.0:1788851119.831105:0:12993:0:(import.c:65:import_set_state_nolock()) ffff8a9ba05c5000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788851119.831110:0:12993:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a9ba05c2800): rc 0 00000020:00000080:1.0:1788851119.831116:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9ba05c2800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788851119.831124:0:12993:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9708418d3ae0 00000100:00080000:1.0:1788851119.831143:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788851119.831146:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788851119.831157:0:12993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788851119.831232:0:12993:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788851119.831253:0:12993:0:(import.c:65:import_set_state_nolock()) ffff8a9b8675a000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788851119.831267:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788851119.831269:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788851119.831275:0:12993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788851119.831347:0:12993:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788851119.831353:0:12993:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c35800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788851119.831380:0:12993:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8a9bb45e8000) has no exports 00010000:00010000:0.0:1788851119.831647:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788851119.831657:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576baa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831665:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6200 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788851119.831669:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576baa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831678:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ad3e1a879576baa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851119.831686:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ad3e1a879576baa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851119.831692:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851119.831695:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788851119.831698:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788851119.831724:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576baa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831731:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851119.831749:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576baa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831756:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6200/0x7ad3e1a879576ba3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576baa expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831770:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788851119.831773:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576ad1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831809:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4000 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788851119.831812:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576ad1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831819:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ad3e1a879576ad1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851119.831825:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ad3e1a879576ad1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851119.831829:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851119.831831:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788851119.831833:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788851119.831848:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576ad1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831853:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851119.831867:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576ad1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831873:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879576aca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576ad1 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831887:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788851119.831891:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576dd3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831896:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547600 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788851119.831898:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576dd3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831910:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ad3e1a879576dd3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851119.831916:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ad3e1a879576dd3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851119.831921:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788851119.831923:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788851119.831925:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788851119.831939:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576dd3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831945:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851119.831951:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576dd3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831956:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879576dcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576dd3 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831965:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851119.831968:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a87957687e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576885 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831973:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5200 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788851119.831975:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a87957687e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576885 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.831982:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a87957687e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ad3e1a879576885 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851119.831998:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a87957687e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ad3e1a879576885 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851119.832004:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851119.832006:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788851119.832008:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788851119.832021:0:5849:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a87957687e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576885 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.832026:0:5849:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851119.832032:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a87957687e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576885 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.832039:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a87957687e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576885 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.832052:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851119.832054:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851119.832056:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851119.832222:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851119.832245:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019693440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851119.832321:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851119.832387:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851119.832405:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019693312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851119.832430:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851119.832611:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019693440 00000100:00100000:0.0:1788851119.832620:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019693440 00000100:00100000:0.0:1788851119.832672:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019693312 00000100:00100000:0.0:1788851119.832675:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019693312 00000100:00100000:0.0:1788851119.832703:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788851119.832711:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b906b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+19:3309:x1875746019693440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851119.832727:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851119.832745:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9baef58400/0x7ad3e1a879576dd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ad3e1a879576dcc expref: 19 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.832773:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851119.832836:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b906b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+18:3309:x1875746019693440:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851119.832842:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788851119.832898:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788851119.832905:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+17:3309:x1875746019693312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851119.832912:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851119.832921:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af7200/0x7ad3e1a879576ad1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ad3e1a879576aca expref: 17 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851119.832933:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851119.832955:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ad19e61b-7666-4fee-85e9-385935a96ab4+16:3309:x1875746019693312:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851119.832961:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788851119.833484:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019693568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851119.833522:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788851119.833654:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851119.833672:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019692928:0@lo:9:umount.0 00000100:00100000:3.0:1788851119.833709:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851119.833749:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019693056:0@lo:9:umount.0 00000100:00100000:3.0:1788851119.833773:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851119.833849:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019692928 00000100:00100000:3.0:1788851119.833854:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019692928 00000100:00100000:3.0:1788851119.833894:0:8281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019693056 00000100:00100000:3.0:1788851119.833898:0:8281:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019693056 00000100:00100000:3.0:1788851119.833921:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788851119.833929:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875746019692928:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788851119.833963:0:8281:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576a22 00000100:00080000:3.0:1788851119.833972:0:8281:0:(import.c:65:import_set_state_nolock()) ffff8a9baf33d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788851119.834014:0:8281:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788851119.834377:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3307:x1875746019692928:12345-0@lo:9:umount.0 Request processed in 447us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851119.834384:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788851119.834412:0:8281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788851119.834419:0:8281:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875746019693056:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788851119.834433:0:8281:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576afb 00000100:00080000:3.0:1788851119.834438:0:8281:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c37800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788851119.834464:0:8281:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:1.0:1788851119.836721:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788851119.836799:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b8675a000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788851119.836821:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788851119.836824:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788851119.836831:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1d77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019692928:0@lo:9:umount.0 00000100:00080000:1.0:1788851119.836872:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788851119.836878:0:5857:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788851119.836884:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851119.837013:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851119.837023:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019693184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851119.837081:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851119.837112:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019693568 00000100:00100000:2.0:1788851119.837119:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019693568 00000100:00100000:2.0:1788851119.837167:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019693184 00000100:00100000:2.0:1788851119.837171:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019693184 00000100:00100000:2.0:1788851119.837189:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788851119.837197:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad19e61b-7666-4fee-85e9-385935a96ab4+17:3310:x1875746019693568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851119.837212:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851119.837240:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a3200/0x7ad3e1a879576885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ad3e1a87957687e expref: 17 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851119.837260:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851119.837295:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad19e61b-7666-4fee-85e9-385935a96ab4+16:3310:x1875746019693568:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (3772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851119.837302:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788851119.837317:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788851119.837324:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3c27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad19e61b-7666-4fee-85e9-385935a96ab4+15:3310:x1875746019693184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851119.837332:0:6721:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851119.837341:0:6721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b8168e000/0x7ad3e1a879576baa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7ad3e1a879576ba3 expref: 15 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851119.837351:0:6721:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851119.837371:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3c27100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ad19e61b-7666-4fee-85e9-385935a96ab4+14:3310:x1875746019693184:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851119.837377:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:00000080:2.0:1788851119.837416:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb44b6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788851119.837482:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9ba05c2800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788851119.837508:0:12292:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9bb44b1800 for lustre-MDT0000 00000020:00000080:2.0:1788851119.837513:0:12292:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9ba05c5000 for lustre-MDT0000 00000100:00100000:3.0:1788851119.837993:0:8281:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3307:x1875746019693056:12345-0@lo:9:umount.0 Request processed in 3572us (4217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851119.838004:0:8281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788851119.838143:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c35800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788851119.838156:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788851119.838159:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788851119.838163:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019693056:0@lo:9:umount.0 00000100:00100000:2.0:1788851119.841295:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019693312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851119.841316:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ad19e61b-7666-4fee-85e9-385935a96ab4:3309:1875746019693440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851119.841360:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019693184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788851119.841371:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019693568:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1788851119.858763:0:12993:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8a9bb45e8000) has no exports 00010000:00010000:3.0:1788851119.891634:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788851119.978322:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a8795768d9 00000020:00000080:2.0:1788851119.978341:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9bb62ca800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788851119.978370:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788851119.980875:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788851119.980893:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788851119.980899:0:12993:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8a9b90473380) has no exports 00000020:00000080:1.0:1788851119.981430:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a8795768d2 00000020:00000080:1.0:1788851119.981442:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9bb4290000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788851119.981505:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851119.981513:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788851119.981672:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb62ca800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788851119.981679:0:8:0:(genops.c:885:class_export_put()) final put ffff8a9bb4294000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788851119.981681:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb4294000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788851119.981689:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788851119.981843:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb4290000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788851119.982096:0:12993:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a9b98cbf720 - data ffff8a9baf9aa798/ffff8a9bc18c7000 00000020:01000000:1.0:1788851119.982241:0:12993:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a9b8bc49ba0 - data ffff8a9bbabd1510/ffff8a9b8bc7f400 00000001:00000004:1.0:1788851120.009663:0:12993:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1788851120.120174:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788851120.120186:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1788851120.120263:0:12993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788851120.120266:0:12993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788851120.128290:0:7148:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788851120.128302:0:7148:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788851120.128342:0:7148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788851120.129304:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788851120.129312:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1788851120.129343:0:12993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788851120.129345:0:12993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788851120.130228:0:8077:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788851120.130235:0:8077:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788851120.130246:0:8077:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788851120.247517:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a8795768a1 00000020:00000080:1.0:1788851120.247545:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9bb45fb000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788851120.248912:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a8795768b6 00000020:00000080:1.0:1788851120.248924:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9bb45fe000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788851120.248932:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788851120.248938:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851120.248947:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788851120.248951:0:12993:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8a9bb45e99c0) has no exports 00000004:01000000:1.0:1788851120.249117:0:12993:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788851120.249126:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576af4 00000020:00000080:1.0:1788851120.249130:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9b87c37000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788851120.249134:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788851120.249138:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851120.249144:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788851120.249147:0:12993:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8a9bb3f3cd40) has no exports 00000020:00000080:1.0:1788851120.249155:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576aed 00000020:00000080:1.0:1788851120.249158:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9b87c36000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788851120.249558:0:12993:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788851120.249564:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788851120.249569:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788851120.249575:0:12993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788851120.249578:0:12993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788851120.249613:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851120.249622:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788851120.249630:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576a0d 00000020:00000080:1.0:1788851120.249635:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9baf33d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788851120.249639:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788851120.249642:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851120.249645:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788851120.249648:0:12993:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8a9b98d14d40) has no exports 00000020:00000080:1.0:1788851120.249652:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576a06 00000020:00000080:1.0:1788851120.249666:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9b86759800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788851120.250030:0:12993:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788851120.250034:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788851120.250037:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788851120.250041:0:12993:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788851120.250043:0:12993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788851120.250069:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851120.250074:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788851120.250100:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851120.250104:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788851120.250134:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a8795768bd 00000020:00000080:1.0:1788851120.250139:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9bb45fc800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788851120.250145:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788851120.250149:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851120.250152:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788851120.250154:0:12993:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8a9bb45eb380) has no exports 00000020:00000080:1.0:1788851120.250175:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851120.250178:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788851120.250182:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a8795768c4 00000020:00000080:1.0:1788851120.250186:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9bb45f8000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788851120.250485:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb45fb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788851120.250504:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb45fe000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788851120.250509:0:8:0:(genops.c:885:class_export_put()) final put ffff8a9b9041e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788851120.250511:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b9041e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788851120.250515:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788851120.250677:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b87c37000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788851120.250681:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b87c36000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788851120.250686:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9b87c35800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788851120.250691:0:8:0:(genops.c:885:class_export_put()) final put ffff8a9b9049b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788851120.250693:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b9049b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788851120.250697:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788851120.250722:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9baf33d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788851120.250728:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b86759800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788851120.250732:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9b8675a000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788851120.250736:0:8:0:(genops.c:885:class_export_put()) final put ffff8a9baf33c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788851120.250737:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9baf33c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788851120.250743:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788851120.250823:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb45fc800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788851120.250827:0:8:0:(genops.c:885:class_export_put()) final put ffff8a9bb45f9000/lustre-MDD0000_UUID 00000020:00000080:0.0:1788851120.250829:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb45f9000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788851120.250833:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1788851120.251025:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb45f8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1788851120.255268:0:12993:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a9ba0462000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788851120.255280:0:12993:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a9ba0462000 3 00000020:01000004:1.0:1788851120.255285:0:12993:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a9ba0462000 from lustre-MDT0000 00000020:00000080:1.0:1788851120.255325:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851120.255337:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788851120.255343:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9bb45fb800/lustre-MDT0000_UUID 00000020:00000080:1.0:1788851120.255346:0:12993:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb45fb800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788851120.255358:0:12993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788851120.255438:0:12993:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788851120.255442:0:12993:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788851120.255446:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788851120.255450:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851120.255455:0:12993:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788851120.255473:0:12993:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8a9b90418000 ad19e61b-7666-4fee-85e9-385935a96ab4 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788851120.255481:0:12993:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8a9b98c919c0) has exports, disconnecting them 00000020:00080000:1.0:1788851120.255486:0:12993:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8a9b90418000), last request at 1788850877 00000020:00000080:1.0:1788851120.255505:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576862 00000020:00010000:1.0:1788851120.255510:0:12993:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8a9b90418000: total 0 00000100:00080000:1.0:1788851120.255516:0:12993:0:(import.c:65:import_set_state_nolock()) ffff8a9b9041c800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788851120.255588:0:12993:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a9b90418000): rc 0 00000020:00080000:1.0:1788851120.255594:0:12993:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8a9b98c919c0) has no exports 00000100:00100000:1.0:1788851120.255671:0:5853:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8a9b86334000:5853] 0 exiting: rc = 1 00000100:00100000:0.0:1788851120.255950:0:5856:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8a9b82b32600:5856] 2 exiting: rc = 0 00000100:00100000:0.0:1788851120.256900:0:5855:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8a9b8bddc000:5855] 1 exiting: rc = 0 00000100:00100000:1.0:1788851120.257973:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.257984:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.257992:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.257998:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258005:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258010:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258017:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258024:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258030:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258036:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258043:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258049:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258056:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258063:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258068:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258075:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258081:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258087:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258094:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258100:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258108:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258114:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258121:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258127:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258152:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258161:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258168:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258174:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258180:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258186:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258191:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258196:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258201:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258206:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258212:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258218:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258224:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258230:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258235:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258240:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258245:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258250:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258255:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258260:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258266:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258270:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258275:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258281:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258286:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258290:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258296:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258301:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258305:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258311:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258317:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258322:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258328:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258334:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258340:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258354:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258359:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258365:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258371:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851120.258377:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788851120.258827:0:12993:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788851120.258831:0:12993:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:1.0:1788851120.260821:0:12993:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8a9b814a3800/0x7ad3e1a87957697a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x7ad3e1a879576973 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.260945:0:12993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a3800/0x7ad3e1a87957697a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x7ad3e1a879576973 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.260964:0:12993:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8a9b98af6400/0x7ad3e1a879576b64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x7ad3e1a879576b5d expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.260972:0:12993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af6400/0x7ad3e1a879576b64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x7ad3e1a879576b5d expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.260981:0:12993:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8a9b814a2000/0x7ad3e1a879576b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x7ad3e1a879576b6b expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.260988:0:12993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a2000/0x7ad3e1a879576b72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x7ad3e1a879576b6b expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.260995:0:12993:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8a9b80031800/0x7ad3e1a879576b80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x7ad3e1a879576b79 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.261002:0:12993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b80031800/0x7ad3e1a879576b80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x7ad3e1a879576b79 expref: 6 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.261010:0:12993:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8a9b80030400/0x7ad3e1a879576b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x7ad3e1a879576b87 expref: 5 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.261030:0:12993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b80030400/0x7ad3e1a879576b8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x7ad3e1a879576b87 expref: 5 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.261039:0:12993:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8a9b814a3000/0x7ad3e1a879576bb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x7ad3e1a879576bb1 expref: 4 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.261045:0:12993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a3000/0x7ad3e1a879576bb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x7ad3e1a879576bb1 expref: 4 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.261055:0:12993:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8a9baef59200/0x7ad3e1a879576db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x7ad3e1a879576da9 expref: 3 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.261063:0:12993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9baef59200/0x7ad3e1a879576db0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x7ad3e1a879576da9 expref: 3 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.261070:0:12993:0:(ldlm_resource.c:1180:cleanup_resource()) ### Freeing a lock still held by a client node ns: MGS lock: ffff8a9b90546200/0x7ad3e1a879576dbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40106400000000 nid: 0@lo remote: 0x7ad3e1a879576db7 expref: 2 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851120.261076:0:12993:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b90546200/0x7ad3e1a879576dbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44907400000000 nid: 0@lo remote: 0x7ad3e1a879576db7 expref: 2 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00010000:2.0:1788851120.261142:0:7644:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8a9b90418000: total 0 00010000:00010000:2.0:1788851120.261196:0:7644:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8a9b90418000, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788851120.261212:0:7644:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8a9b90418000, canceled 0 locks, left on hash table 0. 00000020:00000080:2.0:1788851120.261222:0:7644:0:(genops.c:885:class_export_put()) final put ffff8a9b90418000/ad19e61b-7666-4fee-85e9-385935a96ab4 00010000:00010000:2.0:1788851120.261244:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851120.261247:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851120.261248:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788851120.261289:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b90418000/ad19e61b-7666-4fee-85e9-385935a96ab4 for MGS 00000020:00000080:0.0:1788851120.261329:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9b9041c800 for MGS 00010000:00010000:1.0:1788851120.914383:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851121.938107:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851122.195893:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019693952:0@lo:400:kworker.0 00000100:00100000:2.0:1788851122.195984:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851122.196055:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788851122.196062:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875746019693824:0@lo:400:kworker.0 00000100:00100000:2.0:1788851122.196086:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851122.196181:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019693952 00000100:00100000:1.0:1788851122.196190:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019693952 00000100:00100000:1.0:1788851122.196233:0:5861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019693824 00000100:00100000:1.0:1788851122.196237:0:5861:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019693824 00000100:00100000:1.0:1788851122.196257:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788851122.196265:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875746019693952:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788851122.196273:0:5861:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788851122.196333:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875746019693952:12345-0@lo:400:kworker.0 Request processed in 67us (348us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788851122.196340:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788851122.196371:0:5861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788851122.196376:0:5861:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875746019693824:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788851122.196389:0:5861:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788851122.196411:0:5861:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875746019693824:12345-0@lo:400:kworker.0 Request processed in 34us (324us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788851122.196417:0:5861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788851122.196523:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788851122.196535:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019693696:0@lo:400:kworker.0 00000400:00000100:0.0:1788851122.196563:0:3310:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875746019693696 offset 0 length 224: 4 00000100:00080000:2.0:1788851122.196750:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788851122.196755:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8a9baf33b000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788851122.196766:0:3309:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788851122.213659:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8a9baf33b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851122.213676:0:3309:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 227 00000100:00080000:2.0:1788851122.213695:0:3309:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a9baf33b000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1788851122.213742:0:3309:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9bb4169500 x1875746019694080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851122.213846:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4169500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875746019694080:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788851122.213930:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851122.214026:0:12905:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019694080 00000100:00100000:0.0:1788851122.214037:0:12905:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019694080 00000100:00100000:0.0:1788851122.214086:0:12905:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788851122.214094:0:12905:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3307:x1875746019694080:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1788851122.214115:0:12905:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788851122.214395:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1875746019693824:0@lo:400:kworker.0 00000100:00080000:2.0:1788851122.214422:0:3309:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788851122.214427:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8a9b86759000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788851122.214430:0:3309:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788851122.214434:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8a9b86759000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851122.214437:0:3309:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 245 00000100:00080000:2.0:1788851122.214444:0:3309:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a9b86759000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1788851122.214461:0:3309:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9bb4168700 x1875746019694208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851122.214497:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4168700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875746019694208:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788851122.214526:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851122.214850:0:8079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019694208 00000100:00100000:1.0:1788851122.214856:0:8079:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019694208 00000100:00100000:1.0:1788851122.214884:0:8079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788851122.214889:0:8079:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1875746019694208:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788851122.214902:0:8079:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788851122.214953:0:8079:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3307:x1875746019694208:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 62us (425us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788851122.214961:0:8079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788851122.215281:0:12905:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3307:x1875746019694080:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 1186us (1360us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788851122.215289:0:12905:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:3.0:1788851122.215375:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9baf33b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788851122.215381:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788851122.215385:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4169500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875746019694080:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788851122.215409:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b86759000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788851122.215412:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788851122.215415:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4168700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875746019694208:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1788851122.215564:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1ee0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019693952:0@lo:400:kworker.0 00000020:01000000:1.0:1788851122.260951:0:12993:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a9b98cbf900 - data ffff8a9baf9aa5e8/ffff8a9baff18c00 00000020:01000000:1.0:1788851122.261128:0:12993:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a9bab4ff420 - data ffff8a9bbab86510/ffff8a9b87d06800 00000020:00000080:1.0:1788851122.264308:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576846 00000020:00000080:1.0:1788851122.264321:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9b91a58000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788851122.264360:0:12993:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a9ba0462000 from MGS, refs=2 00000020:01000004:1.0:1788851122.264364:0:12993:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a9ba0462000 2 00000020:01000004:1.0:1788851122.264368:0:12993:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a9ba0462000 from MGS 00000020:00000080:1.0:1788851122.264409:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851122.264416:0:12993:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788851122.264419:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9b91a5c800/MGS 00000020:00000080:1.0:1788851122.264421:0:12993:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b91a5c800/MGS for MGS 00000020:01000000:1.0:1788851122.264429:0:12993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788851122.264509:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788851122.264515:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851122.264520:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788851122.264528:0:12993:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8a9bb3ab1000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788851122.264535:0:12993:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8a9b98c90000) has exports, disconnecting them 00000020:00080000:1.0:1788851122.264539:0:12993:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8a9bb3ab1000), last request at 1788850878 00000020:00000080:1.0:1788851122.264546:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576911 00000020:00080000:1.0:1788851122.264561:0:12993:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a9bb3ab1000): rc 0 00000020:00000080:1.0:1788851122.264566:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9bb3ab1000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788851122.267981:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b91a58000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788851122.268020:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb3ab1000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788851122.269225:0:12993:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788851122.269234:0:12993:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788851122.269239:0:12993:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788851122.269248:0:12993:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788851122.269496:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851122.269506:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788851122.269515:0:12993:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a9ba0462000 1 00000020:00000080:0.0:1788851122.269523:0:12993:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576838 00000020:00000080:0.0:1788851122.269531:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9b91a59000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788851122.269537:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788851122.269543:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851122.269547:0:12993:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788851122.269550:0:12993:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8a9ba04119c0) has no exports 00000020:00000080:3.0:1788851122.270048:0:12292:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9bb3ab3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788851122.270059:0:12292:0:(genops.c:885:class_export_put()) final put ffff8a9bb3635000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788851122.270062:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb3635000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788851122.270070:0:12292:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788851122.270139:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b91a59000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788851122.341843:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788851122.341859:0:12993:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788851122.341866:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9b8bdb3000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788851122.341871:0:12993:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b8bdb3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788851122.341884:0:12993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788851122.342038:0:12993:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a9ba0467000 00000020:01000000:2.0:1788851122.342065:0:12993:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788851122.342070:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788851122.342086:0:12993:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788851122.342090:0:12993:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8a9ba0410000) has no exports 00000100:00100000:2.0:1788851122.342178:0:12905:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8a9ba27d0000:12905] 4 exiting: rc = 0 00000100:00100000:0.0:1788851122.342543:0:5862:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8a9b87d02600:5862] 1 exiting: rc = 0 00000100:00100000:1.0:1788851122.343585:0:5861:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8a9b87d02800:5861] 0 exiting: rc = 1 00000100:00100000:1.0:1788851122.343670:0:5863:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8a9b87d03e00:5863] 2 exiting: rc = 0 00000100:00100000:1.0:1788851122.343729:0:8079:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8a9ba047aa00:8079] 3 exiting: rc = 0 00000100:00100000:2.0:1788851122.343955:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.343965:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.343973:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.343980:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.343987:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.343993:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344000:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344007:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344014:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344018:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344024:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344031:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344036:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344042:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344048:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344053:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344059:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344065:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344072:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344078:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344084:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344090:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344096:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344103:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344108:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344113:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344119:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344126:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344131:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344138:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344144:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344150:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344169:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344174:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344180:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344198:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344204:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344210:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344215:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344221:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344226:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344231:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344236:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344242:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344247:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344252:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344268:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344404:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344410:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344415:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344420:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344426:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344431:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344437:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344443:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344448:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344453:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344458:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344464:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344469:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344475:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344480:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344485:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.344491:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.353979:0:5864:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8a9b85289400:5864] 0 exiting: rc = 1 00000100:00100000:0.0:1788851122.354873:0:5865:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8a9b85288400:5865] 1 exiting: rc = 0 00000100:00100000:2.0:1788851122.355158:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355168:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355197:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355204:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355212:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355219:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355226:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355232:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355238:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355246:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355252:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355258:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355265:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355270:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355358:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355364:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355369:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355374:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355379:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355385:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355390:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355396:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355402:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355407:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355412:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355418:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355424:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355429:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355435:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355441:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355446:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355452:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355457:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355463:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355468:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355473:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355479:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355491:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355497:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355501:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355507:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355511:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355517:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355522:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355527:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355532:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355537:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355543:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355549:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355554:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355560:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355565:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355570:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355575:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355580:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355585:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355590:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355595:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355600:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355604:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355610:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355616:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355623:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.355629:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851122.356850:0:5867:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8a9bbce00e00:5867] 1 exiting: rc = 0 00000100:00100000:3.0:1788851122.357176:0:5866:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8a9bbce01c00:5866] 0 exiting: rc = 1 00000100:00100000:2.0:1788851122.357389:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357398:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357405:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357412:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357417:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357422:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357429:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357435:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357449:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357455:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357460:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357466:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357471:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357476:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357482:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357502:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357509:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357515:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357522:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357528:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357534:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357541:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357547:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357553:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357559:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357565:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357571:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357591:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357598:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357603:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357608:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357614:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357620:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357626:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357632:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357638:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357643:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357652:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357658:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357677:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357691:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357699:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357705:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357718:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357724:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357730:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357736:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357742:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357749:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357755:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.357762:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.358423:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.358435:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.358441:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.358448:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.358456:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.358465:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.358475:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.358482:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.358488:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.358494:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.358500:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.358507:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.358523:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851122.374073:0:5869:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8a9bbce00200:5869] 1 exiting: rc = 0 00000100:00100000:2.0:1788851122.374614:0:5868:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8a9bbce01400:5868] 0 exiting: rc = 1 00000100:00100000:3.0:1788851122.375058:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375067:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375072:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375078:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375084:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375090:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375095:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375101:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375106:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375110:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375117:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375122:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375127:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375146:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375152:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375171:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375176:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375181:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375187:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375191:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375197:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375202:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375206:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375211:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375215:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375220:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375225:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375230:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375235:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375240:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375245:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375250:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375255:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375273:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375279:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375472:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375478:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375484:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375489:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375495:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375500:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375506:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375512:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375518:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375523:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375529:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375535:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375539:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375545:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375550:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375562:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375568:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375573:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375647:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375652:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375657:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375662:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375667:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375671:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375677:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375681:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375686:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375691:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.375696:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851122.380042:0:5871:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8a9b8694c600:5871] 1 exiting: rc = 0 00000100:00100000:2.0:1788851122.380491:0:5870:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8a9b8694c800:5870] 0 exiting: rc = 1 00000100:00100000:3.0:1788851122.380593:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380603:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380608:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380613:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380618:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380624:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380629:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380635:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380641:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380647:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380653:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380658:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380665:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380670:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380676:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380683:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380689:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380694:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380701:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380707:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380713:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380742:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380748:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380754:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380760:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380765:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380771:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380777:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380816:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380823:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380828:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380833:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380838:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380844:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380850:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380855:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380861:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380867:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380872:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380878:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380885:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380891:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380897:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380903:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.380908:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381037:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381047:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381053:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381058:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381064:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381069:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381074:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381080:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381085:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381091:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381096:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381110:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381115:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381121:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381199:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381209:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381214:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381221:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.381227:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.382680:0:5873:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8a9b87d46800:5873] 1 exiting: rc = 0 00000100:00100000:0.0:1788851122.382865:0:5872:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8a9b87d47800:5872] 0 exiting: rc = 1 00000100:00100000:3.0:1788851122.383091:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383099:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383105:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383111:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383116:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383122:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383201:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383210:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383217:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383222:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383228:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383234:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383239:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383245:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383251:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383262:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383268:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383534:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383541:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383547:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383552:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383557:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383563:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383569:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383574:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383580:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383585:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383609:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383615:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383620:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383625:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383631:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383636:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383642:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383647:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383652:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383657:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383663:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383670:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383675:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383681:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383686:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383692:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383698:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383704:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383710:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383717:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383722:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383727:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383733:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383738:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383743:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383748:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383753:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383759:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383764:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383770:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.383775:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.384122:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.384894:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.384903:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.384909:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.384997:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851122.385003:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851122.387190:0:5875:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8a9b87d47a00:5875] 1 exiting: rc = 0 00000100:00100000:2.0:1788851122.391267:0:5874:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8a9b87d47e00:5874] 0 exiting: rc = 1 00000100:00100000:3.0:1788851122.396207:0:5876:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8a9b87d48200:5876] 2 exiting: rc = 0 00000100:00100000:2.0:1788851122.396447:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396459:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396467:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396473:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396479:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396488:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396495:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396503:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396509:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396539:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396546:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396551:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396558:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396566:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396572:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396578:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396586:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396592:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396600:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396608:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396614:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396620:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396626:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396632:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396639:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396666:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396674:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396680:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396686:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396692:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396700:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396707:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396713:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396720:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396726:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396733:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396739:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396745:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396752:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396759:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396765:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396773:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396820:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396828:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396843:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396849:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396856:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396864:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396870:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396894:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396902:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396908:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396926:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396933:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396941:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396947:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396954:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396960:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396966:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396973:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396979:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396985:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.396992:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851122.397008:0:12993:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788851122.404752:0:12993:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788851122.404767:0:12993:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788851122.404773:0:12993:0:(genops.c:885:class_export_put()) final put ffff8a9b9060d000/MDS_uuid 00000020:00000080:3.0:1788851122.404778:0:12993:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b9060d000/MDS_uuid for MDS 00000020:01000000:3.0:1788851122.404929:0:12993:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788851122.405391:0:12993:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:1.0:1788851122.768772:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788851122.768802:0:6732:0:(genops.c:885:class_export_put()) final put ffff8a9baf338800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788851122.768914:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9baf338800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788851122.768963:0:12292:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9baf33d000 for lustre-OST0000 00010000:00010000:3.0:1788851122.964017:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851123.987042:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788851124.885200:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788851124.885213:0:7656:0:(genops.c:885:class_export_put()) final put ffff8a9b87c31000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788851124.885633:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b87c31000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788851124.885688:0:12292:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9b87c37800 for lustre-OST0001 00010000:00010000:3.0:1788851125.022345:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788851125.988125:0:13146:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788851126.010052:0:13146:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788851126.010116:0:13146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851126.010136:0:13146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576b80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851126.010144:0:13146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576b80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851126.010151:0:13146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576b80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851126.010179:0:13146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788851126.010185:0:13146:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788851126.010208:0:13146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788851126.010213:0:13146:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788851126.010220:0:13146:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788851126.010227:0:13146:0:(import.c:65:import_set_state_nolock()) ffff8a9baf33b000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788851126.010233:0:13146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788851126.010234:0:13146:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788851126.010237:0:13146:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788851126.011286:0:13146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851126.011303:0:13146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576b8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851126.011328:0:13146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576b8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851126.011335:0:13146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576b8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851126.011351:0:13146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788851126.011359:0:13146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576dbe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851126.011365:0:13146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576dbe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851126.011371:0:13146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576dbe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851126.011376:0:13146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576dbe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851126.011403:0:13146:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1788851126.011407:0:13146:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788851126.011427:0:13146:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788851126.011432:0:13146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788851126.011437:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851126.011442:0:13146:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788851126.011448:0:13146:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8a9ba0414d40) has no exports 00000020:00080000:0.0:1788851126.011477:0:13146:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8a9ba0414d40) has no exports 00010000:00010000:1.0:1788851126.013084:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788851126.013100:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576b80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851126.013113:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6800 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:1.0:1788851126.013118:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576b80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851126.013128:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ad3e1a879576b80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851126.013157:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ad3e1a879576b80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851126.013163:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788851126.013166:0:7644:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788851126.013169:0:7644:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788851126.013218:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576b80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851126.013224:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851126.013253:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576b80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851126.013260:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6800/0x7ad3e1a879576b79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576b80 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851126.013294:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851126.013297:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576b8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851126.013302:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6e00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:1.0:1788851126.013305:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576b8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851126.013312:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ad3e1a879576b8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851126.013319:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ad3e1a879576b8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851126.013334:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788851126.013336:0:7644:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788851126.013338:0:7644:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788851126.013355:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576b8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851126.013360:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851126.013366:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576b8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851126.013373:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6e00/0x7ad3e1a879576b87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576b8e expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851126.013382:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851126.013386:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576dbe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851126.013391:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59000 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:1.0:1788851126.013394:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576dbe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851126.013400:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ad3e1a879576dbe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851126.013406:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ad3e1a879576dbe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851126.013411:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788851126.013413:0:7644:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788851126.013415:0:7644:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788851126.013433:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576dbe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851126.013450:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851126.013474:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576dbe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851126.013482:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9baef59000/0x7ad3e1a879576db7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7ad3e1a879576dbe expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851126.013492:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851126.013494:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851126.013496:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851126.013504:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851126.013529:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019694336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851126.013610:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851126.013672:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788851126.013677:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019694464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851126.013694:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851126.013720:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019694592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851126.013741:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851126.013776:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019694336 00000100:00100000:1.0:1788851126.013804:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019694336 00000100:00100000:1.0:1788851126.013847:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019694464 00000100:00100000:1.0:1788851126.013850:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019694464 00000100:00100000:1.0:1788851126.013857:0:6721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019694592 00000100:00100000:1.0:1788851126.013859:0:6721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019694592 00000100:00100000:1.0:1788851126.013883:0:6721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788851126.013892:0:6721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3310:x1875746019694336:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788851126.013898:0:6721:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788851126 with bad export cookie 8850665806419683426 00010000:00010000:3.0:1788851126.017614:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788851126.023299:0:13146:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a9b98cbf780 - data ffff8a9baf9d8ca8/ffff8a9baff26000 00000020:01000000:0.0:1788851126.024041:0:13146:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a9bc1b52e40 - data ffff8a9baf826d80/ffff8a9baf0bdc00 00000100:00100000:2.0:1788851126.029677:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788851126.029693:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3310:x1875746019694464:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788851126.029703:0:5847:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788851126 with bad export cookie 8850665806419683426 00000100:00100000:2.0:1788851126.029844:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf042a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3310:x1875746019694464:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (16148us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788851126.029852:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788851126.029951:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788851126.029956:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1875746019694592:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788851126.029961:0:5847:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788851126 with bad export cookie 8850665806419683426 00000100:00100000:2.0:1788851126.029995:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf040000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1875746019694592:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (16253us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788851126.030019:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788851126.030387:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788851126.030393:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8a9b98c2f000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788851126.030397:0:3310:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.106@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788851126.047182:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.106@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:1.0:1788851126.047318:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851126.047438:0:6721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf041180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3310:x1875746019694336:12345-0@lo:103:ldlm_bl.0 Request processed in 33542us (33824us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788851126.049723:0:6721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788851126.058062:0:3310:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.106@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788851126.058068:0:3310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788851126.058081:0:3310:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a9bb3c25f80 x1875746019693696/t0(0) o400->MGC192.168.204.106@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788851138 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851126.058098:0:3310:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a9baf041f80 x1875746019694336/t0(0) o103->MGC192.168.204.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788851142 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851126.058109:0:3310:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a9baf041500 x1875746019694464/t0(0) o103->MGC192.168.204.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788851142 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851126.058119:0:3310:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a9baf042300 x1875746019694592/t0(0) o103->MGC192.168.204.106@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788851142 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788851126.058130:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788851126.058133:0:3310:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788851126.058135:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788851126.058312:0:3308:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8a9b98c2f000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788851126.058461:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ad19e61b-7666-4fee-85e9-385935a96ab4:3308:1875746019694592:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788851126.059064:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8a9b98c2f000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851126.059072:0:3310:0:(import.c:545:import_select_connection()) MGC192.168.204.106@tcp: connect to NID 0@lo last attempt 210 00000100:00080000:3.0:1788851126.059091:0:3310:0:(import.c:666:import_select_connection()) MGC192.168.204.106@tcp: import ffff8a9b98c2f000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1788851126.061828:0:3310:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9bb45a4000 x1875746019694720/t0(0) o250->MGC192.168.204.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851126.062087:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad19e61b-7666-4fee-85e9-385935a96ab4:3307:1875746019694720:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1788851126.062157:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875746019694720 offset 0 length 520: 4 00000100:00100000:3.0:1788851126.062238:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf041f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019694336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851126.062249:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3c25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019693696:0@lo:400:kworker.0 00000100:00100000:3.0:1788851126.062301:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf041500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ad19e61b-7666-4fee-85e9-385935a96ab4:3310:1875746019694464:0@lo:103:ldlm_bl.0 00100000:10000000:1.0:1788851126.067011:0:13146:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788851126.096744:0:13146:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576996 00000020:00000080:1.0:1788851126.096756:0:13146:0:(genops.c:885:class_export_put()) final put ffff8a9b84f4c000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788851126.096806:0:13146:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a9ba049f800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788851126.096810:0:13146:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a9ba049f800 2 00000020:01000004:1.0:1788851126.096813:0:13146:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a9ba049f800 from lustre-OST0000 00000020:00000080:1.0:1788851126.096843:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851126.096854:0:13146:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788851126.096857:0:13146:0:(genops.c:885:class_export_put()) final put ffff8a9baf10d800/lustre-OST0000_UUID 00000020:00000080:1.0:1788851126.096861:0:13146:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9baf10d800/lustre-OST0000_UUID for lustre-OST0000 00000020:00000080:2.0:1788851126.097363:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b84f4c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788851126.097413:0:13146:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788851126.097490:0:13146:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788851126.097496:0:13146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788851126.097500:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851126.097507:0:13146:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788851126.097515:0:13146:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8a9baf33b800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788851126.097522:0:13146:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8a9bb45ecd40) has exports, disconnecting them 00000020:00080000:1.0:1788851126.097528:0:13146:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8a9baf33b800), last request at 1788850894 00000020:00000080:1.0:1788851126.097533:0:13146:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a8795769c0 00000020:00080000:1.0:1788851126.097547:0:13146:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a9baf33b800): rc 0 00000020:00000080:1.0:1788851126.097554:0:13146:0:(genops.c:885:class_export_put()) final put ffff8a9baf33b800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788851126.098066:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9baf33b800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788851126.106079:0:13146:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788851126.106091:0:13146:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788851126.106097:0:13146:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788851126.106107:0:13146:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788851126.106393:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851126.106424:0:13146:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788851126.106434:0:13146:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a9ba049f800 1 00000020:00000080:0.0:1788851126.106450:0:13146:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576950 00000020:00000080:0.0:1788851126.106462:0:13146:0:(genops.c:885:class_export_put()) final put ffff8a9b84f4b800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788851126.106469:0:13146:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788851126.106479:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851126.106484:0:13146:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788851126.106488:0:13146:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8a9b90474d40) has no exports 00000020:00000080:2.0:1788851126.107059:0:12292:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9baf33b000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788851126.107070:0:12292:0:(genops.c:885:class_export_put()) final put ffff8a9baf339800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788851126.107073:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9baf339800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788851126.107084:0:12292:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788851126.107153:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b84f4b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788851126.180103:0:13146:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851126.180121:0:13146:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788851126.180141:0:13146:0:(genops.c:885:class_export_put()) final put ffff8a9ba049f000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788851126.180147:0:13146:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9ba049f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788851126.180163:0:13146:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788851126.180342:0:13146:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a9ba049c000 00000020:02000400:0.0:1788851126.180409:0:13146:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788851127.057905:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788851127.314326:0:12292:0:(pinger.c:229:ptlrpc_pinger_process_import()) ad19e61b-7666-4fee-85e9-385935a96ab4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788851127.314336:0:12292:0:(pinger.c:247:ptlrpc_pinger_process_import()) ad19e61b-7666-4fee-85e9-385935a96ab4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851127.314353:0:12292:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788851127.314357:0:12292:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788851127.314362:0:12292:0:(import.c:65:import_set_state_nolock()) ffff8a9b86759000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851127.314371:0:12292:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 455 00000100:00080000:1.0:1788851127.314377:0:12292:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788851127.314390:0:12292:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a9b86759000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1788851127.314440:0:12292:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9baf042300 x1875746019694848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851127.314539:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875746019694848:0@lo:38:kworker.0 00000400:00000100:3.0:1788851127.314607:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875746019694848 offset 0 length 520: 4 00010000:00010000:3.0:1788851128.088417:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851129.106949:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788851129.610760:0:13295:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788851129.623442:0:13295:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788851129.623541:0:13295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.623558:0:13295:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576b64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.623565:0:13295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576b64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.623588:0:13295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576b64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.623614:0:13295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788851129.623621:0:13295:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788851129.623652:0:13295:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788851129.623667:0:13295:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a9baf042300 x1875746019694848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788851142 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851129.623687:0:13295:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788851129.623695:0:13295:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788851129.623703:0:13295:0:(import.c:65:import_set_state_nolock()) ffff8a9b86759000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788851129.623709:0:13295:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788851129.623713:0:13295:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a9baf042300 x1875746019694848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788851142 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851129.623720:0:13295:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788851129.623724:0:13295:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:1.0:1788851129.624411:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851129.624421:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576b64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851129.624432:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b80031200 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:1.0:1788851129.624436:0:5849:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576b64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851129.624446:0:5849:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ad3e1a879576b64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851129.624455:0:5849:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ad3e1a879576b64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851129.624461:0:5849:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788851129.624464:0:5849:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788851129.624467:0:5849:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788851129.624484:0:5849:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a9b98c2f000 00010000:00010000:1.0:1788851129.624488:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ad3e1a879576b64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851129.624512:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b80031200/0x7ad3e1a879576b5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ad3e1a879576b64 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851129.624525:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851129.624527:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851129.624529:0:5849:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851129.624631:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875746019694848:0@lo:38:kworker.0 00010000:00010000:0.0:1788851129.632636:0:13295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576b72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.632662:0:13295:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576b72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.632669:0:13295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576b72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.632677:0:13295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576b72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.632719:0:13295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851129.632727:0:13295:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879576db0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.632735:0:13295:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879576db0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.632741:0:13295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576db0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.632747:0:13295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7ad3e1a879576db0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.632759:0:13295:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788851129.632764:0:13295:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788851129.633933:0:13295:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788851129.633940:0:13295:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:0.0:1788851129.633956:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788851129.633965:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576b72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.633976:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ea00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788851129.633980:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576b72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.633991:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ad3e1a879576b72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851129.633999:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ad3e1a879576b72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851129.634017:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788851129.634019:0:7644:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788851129.634022:0:7644:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788851129.634038:0:7644:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a9b98c2f000 00010000:00010000:0.0:1788851129.634043:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ad3e1a879576b72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.634049:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ea00/0x7ad3e1a879576b6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ad3e1a879576b72 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.634063:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851129.634067:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576db0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.634074:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7000 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788851129.634077:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7ad3e1a879576db0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.634083:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ad3e1a879576db0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851129.634090:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ad3e1a879576db0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851129.634094:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788851129.634096:0:7644:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788851129.634098:0:7644:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788851129.634103:0:7644:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a9b98c2f000 00010000:00010000:0.0:1788851129.634106:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ad3e1a879576db0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.634119:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7000/0x7ad3e1a879576da9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ad3e1a879576db0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851129.634134:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851129.634135:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851129.634137:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788851129.634165:0:13295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851129.634173:0:13295:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788851129.634179:0:13295:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8a9b904719c0) has no exports 00010000:00010000:3.0:1788851129.634608:0:5850:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788851129.635336:0:13295:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8a9b904719c0) has no exports 00000020:01000000:0.0:1788851129.638500:0:13295:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a9b98cbfa20 - data ffff8a9baf9d8798/ffff8a9baff25000 00000020:01000000:0.0:1788851129.639616:0:13295:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8a9bbce54d80 - data ffff8a9baf86f798/ffff8a9bb4370800 00100000:10000000:1.0:1788851129.655607:0:13295:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788851129.715603:0:13295:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576a61 00000020:00000080:1.0:1788851129.715615:0:13295:0:(genops.c:885:class_export_put()) final put ffff8a9baf10e000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788851129.715641:0:13295:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a9b866a7000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788851129.715646:0:13295:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a9b866a7000 2 00000020:01000004:1.0:1788851129.715649:0:13295:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8a9b866a7000 from lustre-OST0001 00000020:00000080:1.0:1788851129.715684:0:13295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851129.715697:0:13295:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788851129.715700:0:13295:0:(genops.c:885:class_export_put()) final put ffff8a9b84f4a800/lustre-OST0001_UUID 00000020:00000080:1.0:1788851129.715703:0:13295:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b84f4a800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788851129.715716:0:13295:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788851129.715885:0:13295:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ad19e61b-7666-4fee-85e9-385935a96ab4->MGS 00010000:00010000:1.0:1788851129.715917:0:13295:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879576973 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ad3e1a87957697a expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851129.715931:0:13295:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879576973 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ad3e1a87957697a expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851129.715938:0:13295:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788851129.715942:0:13295:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788851129.715946:0:13295:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788851129.715965:0:13295:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a9b98c2f000 00010000:00010000:1.0:1788851129.715970:0:13295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879576973 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ad3e1a87957697a expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851129.716000:0:13295:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7ad3e1a879576bb8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851129.716007:0:13295:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576bb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7ad3e1a879576bb8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851129.716012:0:13295:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788851129.716014:0:13295:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788851129.716016:0:13295:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788851129.716026:0:13295:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8a9b98c2f000 00010000:00010000:1.0:1788851129.716029:0:13295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b8168ec00/0x7ad3e1a879576bb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7ad3e1a879576bb8 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788851129.716047:0:13295:0:(import.c:65:import_set_state_nolock()) ffff8a9b98c2f000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788851129.716052:0:13295:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788851129.716055:0:13295:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788851129.716057:0:13295:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788851129.716063:0:13295:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788851129.716077:0:13295:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8a9bb45a4000 x1875746019694720/t0(0) o250->MGC192.168.204.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788851136 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788851129.716093:0:13295:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788851129.716096:0:13295:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:2.0:1788851129.716431:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9baf10e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1788851129.716644:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ad19e61b-7666-4fee-85e9-385935a96ab4:3307:1875746019694720:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:1.0:1788851129.717083:0:13295:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788851129.717095:0:13295:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576854 00000020:00000080:1.0:1788851129.717104:0:13295:0:(genops.c:885:class_export_put()) final put ffff8a9b9060a000/ad19e61b-7666-4fee-85e9-385935a96ab4 00000020:01000000:1.0:1788851129.717154:0:13295:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.106@tcp (flags='') 00000020:00000080:1.0:1788851129.717164:0:13295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851129.717173:0:13295:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.106@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788851129.717178:0:13295:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8a9b90470000) has no exports 10000000:01000000:0.0:1788851129.718112:0:5858:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788851129.718217:0:13295:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.106@tcp: client import never connected 00000100:00080000:0.0:1788851129.718228:0:13295:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788851129.718233:0:13295:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788851129.718237:0:13295:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788851129.718240:0:13295:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788851129.724548:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b9060a000/ad19e61b-7666-4fee-85e9-385935a96ab4 for MGC192.168.204.106@tcp 00000020:00000080:2.0:1788851129.726640:0:12292:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9b98c2f000 for MGC192.168.204.106@tcp 00000020:00000080:0.0:1788851129.726698:0:13295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788851129.726713:0:13295:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.106@tcp (uuid ad19e61b-7666-4fee-85e9-385935a96ab4) 00000020:00000080:0.0:1788851129.726721:0:13295:0:(genops.c:885:class_export_put()) final put ffff8a9b98c2b000/ad19e61b-7666-4fee-85e9-385935a96ab4 00000020:00000080:0.0:1788851129.726725:0:13295:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b98c2b000/ad19e61b-7666-4fee-85e9-385935a96ab4 for MGC192.168.204.106@tcp 00000020:01000000:0.0:1788851129.726747:0:13295:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.106@tcp (ad19e61b-7666-4fee-85e9-385935a96ab4) 00000020:01000000:0.0:1788851129.727684:0:13295:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788851129.727696:0:13295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788851129.727706:0:13295:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788851129.727714:0:13295:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8a9b8675c000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788851129.727734:0:13295:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8a9bc1e14d40) has exports, disconnecting them 00000020:00080000:0.0:1788851129.727741:0:13295:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8a9b8675c000), last request at 1788850913 00000020:00000080:0.0:1788851129.727746:0:13295:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576a8b 00000020:00080000:0.0:1788851129.727772:0:13295:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8a9b8675c000): rc 0 00000020:00000080:0.0:1788851129.727777:0:13295:0:(genops.c:885:class_export_put()) final put ffff8a9b8675c000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788851129.733762:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b8675c000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788851129.746635:0:13295:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788851129.746647:0:13295:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788851129.746653:0:13295:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788851129.746662:0:13295:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788851129.748040:0:12292:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8a9b86759000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788851129.748304:0:5849:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788851129.749960:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788851129.750138:0:5850:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1788851129.750523:0:5845:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8a9bab441a00:5845] 1 exiting: rc = 0 00000100:00100000:0.0:1788851129.750590:0:5844:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8a9b99118a00:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1788851129.750717:0:11686:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8a9bb3f04000:11686] 2 exiting: rc = 0 00000100:00100000:1.0:1788851129.751103:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851129.751694:0:5847:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8a9b8bce8600:5847] 1 exiting: rc = 0 00000100:00100000:0.0:1788851129.751872:0:5848:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8a9b8bce8000:5848] 2 exiting: rc = 0 00000100:00100000:0.0:1788851129.752001:0:5846:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8a9b8bce9000:5846] 0 exiting: rc = 1 00000100:00100000:1.0:1788851129.752098:0:6721:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8a9bb448c600:6721] 3 exiting: rc = 0 00000100:00100000:1.0:1788851129.752151:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752159:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752165:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752172:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752179:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752187:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752193:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752210:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752216:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752224:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752231:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752237:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752244:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752251:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752259:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752265:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752273:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752280:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752285:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752291:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752297:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752303:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752309:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752316:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752322:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752328:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752333:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752416:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752421:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752426:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752431:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752436:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752459:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752464:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752468:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752473:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752478:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752483:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752489:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752616:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752623:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752628:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752634:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752640:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752646:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752652:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752658:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752665:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752670:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752676:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752681:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752687:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752692:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752697:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752702:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752708:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752714:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752719:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752724:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752730:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752736:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752741:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752747:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.752752:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788851129.755623:0:13295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851129.755641:0:13295:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788851129.755650:0:13295:0:(genops.c:885:class_export_put()) final put ffff8a9bb6ff4800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788851129.755668:0:13295:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb6ff4800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788851129.755675:0:13295:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788851129.755748:0:13295:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a9b866a7000 1 00000020:00000080:1.0:1788851129.755756:0:13295:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7ad3e1a879576a30 00000020:00000080:1.0:1788851129.755764:0:13295:0:(genops.c:885:class_export_put()) final put ffff8a9bb6ff3800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788851129.755806:0:13295:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788851129.755812:0:13295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851129.755818:0:13295:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788851129.755822:0:13295:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8a9b98d119c0) has no exports 00000020:00000080:2.0:1788851129.756100:0:12292:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9bb6ff3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788851129.793737:0:13295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851129.793759:0:13295:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788851129.793766:0:13295:0:(genops.c:885:class_export_put()) final put ffff8a9b866a0800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788851129.793772:0:13295:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b866a0800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788851129.793817:0:13295:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788851129.794139:0:13295:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8a9b866a1000 00000020:01000000:1.0:1788851129.794166:0:13295:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788851129.794171:0:13295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788851129.794175:0:13295:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788851129.794180:0:13295:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8a9ba0413380) has no exports 00000020:00000080:1.0:1788851129.794216:0:13295:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788851129.794223:0:13295:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788851129.794226:0:13295:0:(genops.c:885:class_export_put()) final put ffff8a9b84f4d000/OSS_uuid 00000020:00000080:1.0:1788851129.794229:0:13295:0:(genops.c:844:class_export_destroy()) destroying export ffff8a9b84f4d000/OSS_uuid for OSS 00000020:01000000:1.0:1788851129.794233:0:13295:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788851129.794438:0:6707:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8a9bc14b5600:6707] 2 exiting: rc = 0 00000100:00100000:3.0:1788851129.794988:0:8281:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8a9b85289800:8281] 3 exiting: rc = 0 00000100:00080000:0.0:1788851129.795225:0:5857:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788851129.795418:0:6704:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8a9bc1ec7600:6704] 0 exiting: rc = 1 00000100:00100000:0.0:1788851129.795473:0:6706:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8a9bc14b4e00:6706] 1 exiting: rc = 0 00000100:00100000:1.0:1788851129.798508:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798522:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798530:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798537:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798543:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798548:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798554:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798560:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798584:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798589:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798595:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798601:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798606:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798612:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798617:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798622:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798634:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798639:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798644:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798660:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798666:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798672:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798678:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798684:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798689:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798694:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798699:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798705:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798710:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798715:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798721:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798726:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798731:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798736:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798741:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798747:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798753:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798759:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798765:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.798772:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799444:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799461:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799467:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799482:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799488:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799493:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799498:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799503:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799509:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799513:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799518:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799522:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799527:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799531:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799537:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799542:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799546:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799551:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799557:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799563:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799573:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799578:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799584:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.799590:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851129.802136:0:6708:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8a9bc14b5200:6708] 0 exiting: rc = 1 00000100:00100000:0.0:1788851129.802295:0:6709:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8a9bc14b4c00:6709] 1 exiting: rc = 0 00000100:00100000:1.0:1788851129.802583:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802594:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802599:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802605:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802611:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802617:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802624:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802629:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802634:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802639:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802645:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802732:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802737:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802741:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802763:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802768:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802773:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.802778:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803133:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803139:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803145:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803150:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803156:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803162:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803168:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803174:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803180:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803187:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803194:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803211:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803217:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803223:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803229:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803235:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803240:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803245:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803251:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803256:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803262:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803267:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803273:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803278:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803284:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803288:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803292:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803298:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803303:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803309:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803314:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803330:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803401:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803410:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803416:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803422:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803428:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803434:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803441:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803446:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803452:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803457:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803463:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803469:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803474:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.803480:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788851129.805857:0:6713:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8a9bc14b5000:6713] 2 exiting: rc = 0 00000100:00100000:2.0:1788851129.806180:0:6712:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8a9bc14b4a00:6712] 1 exiting: rc = 0 00000100:00100000:1.0:1788851129.807646:0:6711:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8a9bc14b5a00:6711] 0 exiting: rc = 1 00000100:00100000:0.0:1788851129.808549:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808561:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808567:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808573:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808580:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808586:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808592:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808598:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808603:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808610:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808616:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808623:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808721:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808731:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808751:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808756:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808762:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808767:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.808773:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809161:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809174:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809180:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809186:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809193:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809208:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809216:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809222:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809228:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809234:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809240:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809247:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809253:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809258:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809264:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809270:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809277:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809303:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809310:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809317:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809322:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809329:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809405:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809414:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809424:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809431:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809437:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809443:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809449:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809456:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809473:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809480:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809486:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809493:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809502:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809510:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809517:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809524:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809542:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809551:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809557:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809563:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809569:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809575:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788851129.809580:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788851129.826209:0:6714:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8a9bbcf92e00:6714] 0 exiting: rc = 1 00000100:00100000:1.0:1788851129.829633:0:6715:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8a9bbcf93600:6715] 1 exiting: rc = 0 00000100:00100000:1.0:1788851129.829809:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.829818:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.829824:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.829829:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.829835:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.829841:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.829848:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.829853:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.829859:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.829865:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.829872:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.829878:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830051:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830061:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830067:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830072:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830078:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830083:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830105:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830111:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830116:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830122:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830127:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830133:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830138:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830144:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830150:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830156:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830161:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830166:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830171:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830175:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830180:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830185:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830190:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830194:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830208:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830213:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830218:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830223:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830228:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830234:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830240:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830245:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830250:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830255:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830260:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830265:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830270:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830275:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830279:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830283:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830288:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830301:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830306:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830311:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830317:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830322:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830328:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830402:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830411:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830415:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830420:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.830425:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.831743:0:6717:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8a9bbcf92c00:6717] 1 exiting: rc = 0 00000100:00100000:0.0:1788851129.831973:0:6716:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8a9bbcf93200:6716] 0 exiting: rc = 1 00000100:00100000:1.0:1788851129.832135:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832144:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832150:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832157:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832164:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832171:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832194:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832213:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832220:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832227:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832235:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832241:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832250:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832259:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832266:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832272:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832281:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832290:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832313:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832321:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832328:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832399:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832412:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832434:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832441:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832449:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832456:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832462:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832469:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832475:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832498:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832506:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832512:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832519:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832526:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832533:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832539:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832546:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832552:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832558:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832564:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832570:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832592:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832600:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832606:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832613:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832619:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832626:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832632:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832639:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832645:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832725:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832731:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832737:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832756:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832764:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832771:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832815:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832836:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832843:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832850:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832856:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832862:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788851129.832874:0:13295:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788851129.849596:0:13295:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788851151.991156:0:13909:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788851161.557832:0:14370:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788851161.557837:0:14370:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788851161.557959:0:14370:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a9b929b7800 00000020:01000004:1.0:1788851161.557977:0:14370:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788851161.557986:0:14370:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788851161.558001:0:14370:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8a9b98d119c0) 00000020:00000080:1.0:1788851161.558016:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788851161.578827:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788851161.581064:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788851161.581403:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 300: rc = 0 00100000:10000000:2.0:1788851161.581631:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 300: rc = 0 00100000:10000000:2.0:1788851161.581733:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 300: rc = 0 00100000:10000000:2.0:1788851161.582028:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788851161.582104:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 300: rc = 0 00100000:10000000:2.0:1788851161.582204:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 300: rc = 0 00100000:10000000:2.0:1788851161.582302:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 300: rc = 0 00100000:10000000:2.0:1788851161.582544:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 302: rc = 0 00100000:10000000:2.0:1788851161.583687:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 642: rc = 0 00100000:10000000:2.0:1788851161.583890:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 642: rc = 0 00100000:10000000:2.0:1788851161.584330:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 648: rc = 0 00100000:10000000:2.0:1788851161.584600:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 648: rc = 0 00100000:10000000:2.0:1788851161.584996:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 648: rc = 0 00100000:10000000:2.0:1788851161.585275:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 648: rc = 0 00100000:10000000:2.0:1788851161.585897:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 648: rc = 0 00100000:10000000:2.0:1788851161.586151:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 648: rc = 0 00100000:10000000:2.0:1788851161.586402:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 648: rc = 0 00100000:10000000:2.0:1788851161.586657:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 648: rc = 0 00100000:10000000:2.0:1788851161.587101:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 648: rc = 0 00100000:10000000:2.0:1788851161.587347:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 648: rc = 0 00100000:10000000:2.0:1788851161.587637:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 648: rc = 0 00100000:10000000:3.0:1788851161.588178:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 648: rc = 0 00100000:10000000:3.0:1788851161.588644:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 783: rc = 0 00100000:10000000:3.0:1788851161.588940:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 783: rc = 0 00100000:10000000:3.0:1788851161.589190:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 783: rc = 0 00100000:10000000:3.0:1788851161.589437:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 783: rc = 0 00100000:10000000:3.0:1788851161.589708:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 783: rc = 0 00100000:10000000:3.0:1788851161.590432:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 783: rc = 0 00100000:10000000:3.0:1788851161.590725:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 783: rc = 0 00100000:10000000:3.0:1788851161.591086:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 783: rc = 0 00100000:10000000:3.0:1788851161.591544:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 783: rc = 0 00100000:10000000:3.0:1788851161.591938:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 783: rc = 0 00100000:10000000:3.0:1788851161.592185:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 783: rc = 0 00100000:10000000:3.0:1788851161.592432:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 783: rc = 0 00100000:10000000:3.0:1788851161.592693:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 783: rc = 0 00100000:10000000:3.0:1788851161.592999:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 783: rc = 0 00100000:10000000:3.0:1788851161.593258:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 783: rc = 0 00100000:10000000:3.0:1788851161.593621:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 783: rc = 0 00100000:10000000:3.0:1788851161.594051:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 783: rc = 0 00100000:10000000:3.0:1788851161.594321:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 783: rc = 0 00100000:10000000:3.0:1788851161.594578:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 783: rc = 0 00100000:10000000:3.0:1788851161.594944:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 783: rc = 0 00100000:10000000:3.0:1788851161.595189:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 783: rc = 0 00100000:10000000:3.0:1788851161.595440:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 783: rc = 0 00100000:10000000:3.0:1788851161.595708:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 783: rc = 0 00100000:10000000:3.0:1788851161.595991:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 783: rc = 0 00100000:10000000:3.0:1788851161.596237:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 783: rc = 0 00100000:10000000:3.0:1788851161.596494:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 783: rc = 0 00100000:10000000:3.0:1788851161.596771:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 783: rc = 0 00100000:10000000:3.0:1788851161.597916:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 783: rc = 0 00100000:10000000:3.0:1788851161.598176:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 783: rc = 0 00100000:10000000:3.0:1788851161.598470:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 783: rc = 0 00100000:10000000:3.0:1788851161.598738:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 783: rc = 0 00100000:10000000:3.0:1788851161.599042:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 783: rc = 0 00100000:10000000:3.0:1788851161.599411:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 424: rc = 0 00100000:10000000:3.0:1788851161.600056:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788851161.600232:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:3.0:1788851161.600475:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788851161.600542:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:3.0:1788851161.600751:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788851161.603218:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:3.0:1788851161.604223:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788851161.604311:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 643: rc = 0 00100000:10000000:3.0:1788851161.604499:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788851161.604564:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 643: rc = 0 00100000:10000000:3.0:1788851161.604767:0:14370:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788851161.604880:0:14370:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 643: rc = 0 00000020:00000080:3.0:1788851161.605152:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788851161.605160:0:14370:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788851161.605173:0:14370:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ad3e1a879577b47 00000020:01000004:3.0:1788851161.605180:0:14370:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788851161.605185:0:14370:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788851161.605191:0:14370:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a9b929b7800 from MGS 00000020:01000004:3.0:1788851161.605195:0:14370:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788851161.605206:0:14370:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8a9b98c90000) 00000020:00000080:3.0:1788851161.605216:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788851161.605274:0:14370:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a9b929b7800 from MGS, refs=2 00080000:01000000:3.0:1788851161.605279:0:14370:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788851161.605283:0:14370:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ad3e1a879577b55 00000100:00100000:3.0:1788851161.605372:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788851161.605501:0:14370:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788851161.605507:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788851161.607358:0:14370:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788851161.607373:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788851161.608465:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788851161.608660:0:14370:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788851161.608666:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788851161.609615:0:14370:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788851161.609624:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788851161.610194:0:14370:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788851161.610201:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788851161.611769:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851161.611774:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851161.611776:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851161.612146:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851161.612148:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851161.612150:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851161.613050:0:14370:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788851161.616734:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788851161.624075:0:14370:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788851161.624096:0:14370:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788851161.624099:0:14370:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788851161.625656:0:14379:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788851161.625815:0:14370:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788851161.625908:0:14370:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788851161.626554:0:14370:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788851161.626894:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788851161.631283:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788851161.631303:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788851161.632918:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788851161.632927:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788851161.634027:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788851161.634049:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788851161.638020:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788851161.638048:0:14370:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.106@tcp' 00000020:01000004:1.0:1788851161.638049:0:14370:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788851161.638080:0:14370:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.106@tcp (typ=mgc) 00000020:00000080:1.0:1788851161.638093:0:14370:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.106@tcp (ffff8a9b98d10000) 00000020:00000080:1.0:1788851161.638110:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788851161.638204:0:14370:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a9b8da72000@MGC192.168.204.106@tcp: add connection 192.168.204.106@tcp at head 00010000:00010000:1.0:1788851161.638346:0:14370:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.106@tcp-0 is initialized 00000040:01000000:1.0:1788851161.638352:0:14370:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788851161.638470:0:14384:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788851161.649287:0:14385:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788851161.650252:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.106@tcp (uuid 88a8a83d-2380-4e6d-b8f7-1327e5aed605) 00000020:00000080:1.0:1788851161.650277:0:14370:0:(genops.c:1384:class_connect()) connect: client 88a8a83d-2380-4e6d-b8f7-1327e5aed605, cookie 0x7ad3e1a879577b63 00000100:00080000:1.0:1788851161.650288:0:14370:0:(import.c:545:import_select_connection()) MGC192.168.204.106@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788851161.650301:0:14370:0:(import.c:666:import_select_connection()) MGC192.168.204.106@tcp: import ffff8a9b8da72000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1788851161.650346:0:14370:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9baf042a00 x1875746019694976/t0(0) o250->MGC192.168.204.106@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788851161.650415:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3307:1875746019694976:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788851161.650492:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851161.650608:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019694976 00000100:00100000:2.0:1788851161.650616:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019694976 00000100:00100000:2.0:1788851161.650663:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788851161.650669:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1875746019694976:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788851161.650700:0:14380:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 88a8a83d-2380-4e6d-b8f7-1327e5aed605@0@lo t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:2.0:1788851161.650724:0:14380:0:(genops.c:1384:class_connect()) connect: client 88a8a83d-2380-4e6d-b8f7-1327e5aed605, cookie 0x7ad3e1a879577b6a 00000100:00080000:2.0:1788851161.650888:0:14380:0:(import.c:65:import_set_state_nolock()) ffff8a9ba0fc4800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788851161.651433:0:14370:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 88a8a83d-2380-4e6d-b8f7-1327e5aed605->MGS 00000020:01000004:1.0:1788851161.651457:0:14370:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788851161.651462:0:14370:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788851161.651479:0:14370:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8a9b98d13380) 00000020:00000080:1.0:1788851161.651490:0:14370:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788851161.662515:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+5:3307:x1875746019694976:12345-0@lo:250:mount.lustre.0 Request processed in 11831us (12010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851161.662531:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788851161.662762:0:3307:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.106@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788851161.662775:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.106@tcp: connect to target with instance 0 00000100:00080000:0.0:1788851161.662808:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.106@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788851161.662814:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788851161.662819:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b8da72000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788851161.662822:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788851161.662836:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788851161.662842:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3307:1875746019694976:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788851161.665351:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788851161.665894:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788851161.665902:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788851161.666690:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788851161.666698:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788851161.667132:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788851161.667139:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788851161.667898:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788851161.669391:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788851161.669399:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788851161.670153:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788851161.670162:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788851161.731404:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788851161.731653:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788851161.731661:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788851161.733337:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788851161.733350:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788851161.734137:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788851161.734422:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788851161.734428:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788851161.735258:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788851161.735267:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788851161.736067:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788851161.736315:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788851161.736321:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788851161.737063:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788851161.737073:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788851161.738112:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788851161.738364:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788851161.738369:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788851161.739099:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788851161.739107:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788851161.787605:0:14370:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788851161.788413:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788851161.788422:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788851161.792286:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788851161.792303:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788851161.793172:0:14370:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788851161.793254:0:14370:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788851161.796260:0:14370:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788851161.796288:0:14370:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788851161.796296:0:14370:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.106@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788851161.796437:0:14370:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788851161.796472:0:14370:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.106@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788851161.796480:0:14370:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788851161.796481:0:14370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788851161.796483:0:14370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851161.796484:0:14370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851161.796485:0:14370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851161.796486:0:14370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851161.796487:0:14370:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788851161.796488:0:14370:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788851161.796489:0:14370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851161.796491:0:14370:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788851161.796493:0:14370:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788851161.796495:0:14370:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788851161.796496:0:14370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788851161.796497:0:14370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851161.796497:0:14370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851161.796498:0:14370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851161.796499:0:14370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851161.796500:0:14370:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788851161.796501:0:14370:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788851161.796502:0:14370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851161.796503:0:14370:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788851161.796527:0:14370:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788851161.796550:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019695104:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788851161.796645:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851161.796736:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf42840 going to sleep for 11 seconds 00000100:00100000:0.0:1788851161.799401:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019695104 00000100:00100000:0.0:1788851161.799415:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019695104 00000100:00100000:0.0:1788851161.799589:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851161.799601:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+5:14370:x1875746019695104:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788851161.799670:0:14383:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788851161.799673:0:14383:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788851161.799677:0:14383:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788851161.800266:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788851161.800672:0:14383:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788851161.802388:0:14405:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788851161.802396:0:14405:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788851161.802398:0:14405:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788851161.802434:0:14405:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788851161.802739:0:14383:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788851161.802751:0:14383:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788851161.809150:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+5:14370:x1875746019695104:12345-0@lo:253:mount.lustre.0 Request processed in 9542us (12495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851161.809170:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788851161.809346:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019695104:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788851161.809362:0:14370:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788851161.809365:0:14370:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788851161.809367:0:14370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788851161.809368:0:14370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851161.809370:0:14370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851161.809371:0:14370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851161.809372:0:14370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851161.809373:0:14370:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788851161.809375:0:14370:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788851161.809377:0:14370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851161.809378:0:14370:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788851161.809411:0:14370:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a9b929b7800 from lustre-MDT0000 10000000:01000000:2.0:1788851161.809443:0:14370:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788851161.809446:0:14370:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788851161.809451:0:14370:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8a9b98d10000 10000000:01000000:2.0:1788851161.809455:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788851161.809463:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8a9b98d10000 from 1 10000000:01000000:2.0:1788851161.809466:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788851161.809504:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547000/0x7ad3e1a879577b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851161.809514:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b90547000/0x7ad3e1a879577b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851161.809522:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b90547000/0x7ad3e1a879577b78 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851161.809543:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019695232:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788851161.809594:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851161.809632:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbcf42300 going to sleep for 11 seconds 00000100:00100000:1.0:1788851161.809729:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019695232 00000100:00100000:1.0:1788851161.809736:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019695232 00000100:00100000:1.0:1788851161.809820:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788851161.809831:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+5:14370:x1875746019695232:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851161.809845:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851161.810605:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b90546c00/0x7ad3e1a879577b7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577b78 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851161.810654:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90546c00/0x7ad3e1a879577b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577b78 expref: 6 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851161.810667:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b90546c00/0x7ad3e1a879577b7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577b78 expref: 6 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851161.810676:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546c00, rc 0) 00000100:00100000:2.0:1788851161.810778:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+6:14370:x1875746019695232:12345-0@lo:101:mount.lustre.0 Request processed in 949us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851161.810824:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788851161.811126:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019695232:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851161.811144:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b90547000/0x7ad3e1a879577b78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577b7f expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851161.811154:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b90547000/0x7ad3e1a879577b78 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577b7f expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851161.811309:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019695360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851161.811347:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851161.811414:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905fd240 going to sleep for 11 seconds 00000100:00100000:1.0:1788851161.811452:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019695360 00000100:00100000:1.0:1788851161.811457:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019695360 00000100:00100000:1.0:1788851161.811513:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788851161.811522:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+6:14370:x1875746019695360:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851161.811761:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+6:14370:x1875746019695360:12345-0@lo:501:mount.lustre.0 Request processed in 239us (413us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788851161.811768:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851161.811842:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019695360:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788851161.811872:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788851161.811887:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547000/0x7ad3e1a879577b78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577b7f expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851161.811895:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b90547000/0x7ad3e1a879577b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577b7f expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851161.811903:0:14370:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a9b929b7800 10000000:01000000:0.0:1788851161.811907:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788851161.811910:0:14370:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8a9b929b7800 10000000:01000000:0.0:1788851161.811912:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788851161.811915:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8a9b929b7800 from 1 10000000:01000000:0.0:1788851161.811917:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788851161.811937:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879577b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851161.811944:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879577b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851161.811953:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879577b86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851161.811964:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019695488:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788851161.811999:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851161.812367:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905fd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788851161.812425:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019695488 00000100:00100000:3.0:1788851161.812430:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019695488 00000100:00100000:3.0:1788851161.812465:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788851161.812472:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+6:14370:x1875746019695488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851161.812481:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851161.812494:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a4a00/0x7ad3e1a879577b8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577b86 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851161.812518:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a4a00/0x7ad3e1a879577b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577b86 expref: 7 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851161.812528:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a4a00/0x7ad3e1a879577b8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577b86 expref: 7 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851161.812535:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4a00, rc 0) 00000100:00100000:3.0:1788851161.812627:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+7:14370:x1875746019695488:12345-0@lo:101:mount.lustre.0 Request processed in 155us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851161.812634:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788851161.812687:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019695488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851161.812699:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879577b86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577b8d expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851161.812708:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879577b86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577b8d expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851161.812720:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788851161.812736:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879577b86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577b8d expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851161.812744:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6400/0x7ad3e1a879577b86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577b8d expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851161.812750:0:14370:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788851161.812755:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788851161.812759:0:14370:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8a9b929b7800 10000000:01000000:0.0:1788851161.812761:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788851161.812764:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788851161.812766:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788851161.812972:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7200/0x7ad3e1a879577b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851161.812981:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7200/0x7ad3e1a879577b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851161.812989:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7200/0x7ad3e1a879577b94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851161.813012:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019695616:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788851161.813141:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851161.813276:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905fd240 going to sleep for 11 seconds 00000100:00100000:1.0:1788851161.813309:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019695616 00000100:00100000:1.0:1788851161.813315:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019695616 00000100:00100000:1.0:1788851161.813384:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788851161.813392:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+7:14370:x1875746019695616:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851161.813400:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851161.813411:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9baef59400/0x7ad3e1a879577b9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577b94 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851161.813427:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9baef59400/0x7ad3e1a879577b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577b94 expref: 8 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851161.813436:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9baef59400/0x7ad3e1a879577b9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577b94 expref: 8 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851161.813442:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59400, rc 0) 00000100:00100000:1.0:1788851161.813519:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+8:14370:x1875746019695616:12345-0@lo:101:mount.lustre.0 Request processed in 127us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851161.813525:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788851161.813612:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019695616:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851161.813624:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7200/0x7ad3e1a879577b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577b9b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851161.813632:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7200/0x7ad3e1a879577b94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577b9b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851161.813680:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019695744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851161.813703:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851161.813725:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905fd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788851161.813772:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019695744 00000100:00100000:3.0:1788851161.813776:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019695744 00000100:00100000:3.0:1788851161.814015:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851161.814023:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+8:14370:x1875746019695744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851161.814619:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+9:14370:x1875746019695744:12345-0@lo:501:mount.lustre.0 Request processed in 595us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851161.814637:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788851161.814717:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019695744:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851161.814750:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019695872:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788851161.814810:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851161.814836:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905fd240 going to sleep for 11 seconds 00000100:00100000:2.0:1788851161.815129:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019695872 00000100:00100000:2.0:1788851161.815136:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019695872 00000100:00100000:2.0:1788851161.815169:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788851161.815189:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+9:14370:x1875746019695872:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851161.815494:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+9:14370:x1875746019695872:12345-0@lo:503:mount.lustre.0 Request processed in 317us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851161.815501:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788851161.815719:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019695872:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851161.816494:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14406:1875746019696000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788851161.816539:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851161.816607:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788851161.816638:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019696000 00000100:00100000:2.0:1788851161.816643:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019696000 00000100:00100000:2.0:1788851161.816702:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788851161.816711:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+9:14406:x1875746019696000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851161.817264:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+9:14406:x1875746019696000:12345-0@lo:502:llog_process_th.0 Request processed in 553us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851161.817272:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788851161.817443:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14406:1875746019696000:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788851161.817468:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851161.817479:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851161.817481:0:14406:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788851161.817487:0:14406:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788851161.817491:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788851161.817508:0:14406:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8a9bb3f3cd40) 00000020:00000080:0.0:1788851161.817526:0:14406:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788851161.817534:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788851161.817618:0:14406:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788851161.817627:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ad3e1a879577ba9 00000020:00000080:0.0:1788851161.818020:0:14406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788851161.818025:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851161.818097:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851161.818099:0:14406:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788851161.818104:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788851161.818108:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851161.818110:0:14406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788851161.818113:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788851161.818122:0:14406:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8a9bb3f399c0) 00000020:00000080:0.0:1788851161.818133:0:14406:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788851161.818138:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788851161.818140:0:14406:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788851161.818143:0:14406:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788851161.818150:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788851161.818283:0:14406:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a9b929b7800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788851161.818297:0:14406:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8a9bb3f38000) 00000020:00000080:0.0:1788851161.818305:0:14406:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788851161.818356:0:14406:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788851161.818363:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ad3e1a879577bbe 00000020:00000080:0.0:1788851161.818450:0:14406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788851161.818456:0:14406:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788851161.818461:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7ad3e1a879577bc5 00080000:01000000:0.0:1788851161.818466:0:14406:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788851161.818470:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ad3e1a879577bcc 00010000:00010000:2.0:1788851161.945435:0:14406:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788851161.947758:0:14406:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788851161.948698:0:14406:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788851161.951380:0:14406:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8a9bc1e119c0) 00000020:00000080:2.0:1788851161.951413:0:14406:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788851161.951481:0:14406:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788851161.951489:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ad3e1a879577bda 00000020:00000080:2.0:1788851161.954520:0:14406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788851161.964319:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7ad3e1a879577be1 00000020:00000080:3.0:1788851161.966490:0:14406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788851161.966505:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851161.966513:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851161.966515:0:14406:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788851161.966518:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788851161.966521:0:14406:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1788851161.966523:0:14406:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788851161.966524:0:14406:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788851161.966526:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788851161.966528:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851161.966530:0:14406:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788851161.966532:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851161.966538:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851161.966539:0:14406:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788851161.966545:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788851161.966607:0:14406:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788851161.966635:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851161.966639:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851161.966640:0:14406:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788851161.966642:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788851161.966645:0:14406:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788851161.966648:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851161.966650:0:14406:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788851161.966652:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788851161.966657:0:14406:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:01000000:3.0:1788851161.966682:0:14406:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788851161.966695:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788851161.966713:0:14406:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8a9b98c93380) 00000020:00000080:3.0:1788851161.966731:0:14406:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788851161.966736:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788851161.966905:0:14406:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788851161.966911:0:14406:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788851161.966918:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ad3e1a879577bef 00010000:00080000:3.0:1788851161.966951:0:14406:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a9b91a59800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.106@tcp at head 00010000:00010000:3.0:1788851161.967262:0:14406:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788851161.969204:0:14406:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788851161.969260:0:14406:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788851161.984711:0:14406:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788851161.985073:0:14406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788851161.985164:0:14406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788851161.985845:0:14410:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788851161.985851:0:14410:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788851161.990174:0:14406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788851161.990192:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788851161.990236:0:14406:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788851161.990258:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ad3e1a879577bf6 00000100:00080000:1.0:1788851161.990276:0:14406:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788851161.990289:0:14406:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a9b91a59800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1788851161.990326:0:14406:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9baf040000 x1875746019696128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788851161.990482:0:14406:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788851161.990597:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019696128:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788851161.990671:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019696128 offset 0 length 520: 4 00000020:01000000:1.0:1788851161.990853:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851161.990867:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851161.990870:0:14406:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788851161.990873:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788851161.990877:0:14406:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788851161.990879:0:14406:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788851161.990880:0:14406:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788851161.990882:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788851161.990884:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851161.990886:0:14406:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788851161.990888:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788851161.990893:0:14406:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788851161.990897:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851161.990898:0:14406:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788851161.990902:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788851161.990905:0:14406:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.106@tcp to nid 0x20000c0a8cc6a (192.168.204.106@tcp) 00000020:01000000:1.0:1788851161.990927:0:14406:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788851161.990930:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788851161.990944:0:14406:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8a9b98d14d40) 00000020:00000080:1.0:1788851161.990957:0:14406:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788851161.990962:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788851161.991022:0:14406:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788851161.991028:0:14406:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788851161.991035:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7ad3e1a879577c04 00010000:00080000:1.0:1788851161.991066:0:14406:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a9b87c33800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.106@tcp at head 00010000:00010000:1.0:1788851161.991273:0:14406:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788851161.991721:0:14406:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788851161.991746:0:14406:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788851161.992735:0:14406:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788851161.993283:0:14406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788851161.995211:0:14406:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788851161.997709:0:14412:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788851161.997717:0:14412:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788851162.000571:0:14406:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788851162.000597:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788851162.000645:0:14406:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788851162.000666:0:14406:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ad3e1a879577c0b 00000100:00080000:1.0:1788851162.000676:0:14406:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788851162.000687:0:14406:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a9b87c33800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1788851162.000724:0:14406:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9baf041180 x1875746019696256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788851162.000743:0:14406:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788851162.000850:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851162.001182:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851162.001186:0:14406:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788851162.001192:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851162.001197:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851162.001199:0:14406:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788851162.001202:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788851162.001204:0:14406:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788851162.001207:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851162.001209:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851162.001210:0:14406:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788851162.001212:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851162.001214:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851162.001215:0:14406:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788851162.001219:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788851162.001252:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14406:1875746019696384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851162.001330:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851162.001527:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019696256:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788851162.001557:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019696256 offset 0 length 520: 4 00000100:00100000:1.0:1788851162.001647:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbccfe300 going to sleep for 11 seconds 00000100:00100000:3.0:1788851162.003885:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019696384 00000100:00100000:3.0:1788851162.003899:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019696384 00000100:00100000:3.0:1788851162.003969:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788851162.003979:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+9:14406:x1875746019696384:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788851162.004284:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+9:14406:x1875746019696384:12345-0@lo:502:llog_process_th.0 Request processed in 306us (2953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851162.004293:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788851162.005612:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14406:1875746019696384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788851162.005687:0:14406:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851162.005696:0:14406:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851162.005698:0:14406:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788851162.005703:0:14406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788851162.009563:0:14370:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1788851162.009611:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788851162.009725:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7200/0x7ad3e1a879577b94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577b9b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.009741:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7200/0x7ad3e1a879577b94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577b9b expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851162.009750:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a9b929b7800 from 1 10000000:01000000:1.0:1788851162.009753:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788851162.009830:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9baef58600/0x7ad3e1a879577c12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.009839:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9baef58600/0x7ad3e1a879577c12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.009850:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9baef58600/0x7ad3e1a879577c12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851162.009875:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019696512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851162.010168:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851162.010254:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbccfe900 going to sleep for 11 seconds 00000100:00100000:0.0:1788851162.010344:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019696512 00000100:00100000:0.0:1788851162.010352:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019696512 00000100:00100000:0.0:1788851162.010437:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788851162.010448:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+9:14370:x1875746019696512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851162.010462:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851162.010477:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879577c19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577c12 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851162.010614:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879577c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577c12 expref: 10 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851162.010625:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879577c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577c12 expref: 10 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851162.010634:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6200, rc 0) 00000100:00100000:0.0:1788851162.010826:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+10:14370:x1875746019696512:12345-0@lo:101:mount.lustre.0 Request processed in 380us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851162.010833:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788851162.011108:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019696512:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851162.011129:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9baef58600/0x7ad3e1a879577c12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.011203:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9baef58600/0x7ad3e1a879577c12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577c19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851162.012833:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019696640:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788851162.012902:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851162.012950:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbccfe900 going to sleep for 11 seconds 00000100:00100000:3.0:1788851162.013639:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019696640 00000100:00100000:3.0:1788851162.013648:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019696640 00000100:00100000:3.0:1788851162.013704:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788851162.013715:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+10:14370:x1875746019696640:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788851162.013738:0:14382:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788851162.013745:0:14382:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788851162.013879:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+10:14370:x1875746019696640:12345-0@lo:256:mount.lustre.0 Request processed in 165us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851162.013888:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788851162.015107:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019696640:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788851162.015829:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788851162.016018:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9baef58600/0x7ad3e1a879577c12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851162.016050:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9baef58600/0x7ad3e1a879577c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851162.017976:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9b929b7800 from 1 10000000:01000000:1.0:1788851162.017985:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788851162.018032:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9baef59600/0x7ad3e1a879577c20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.018045:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9baef59600/0x7ad3e1a879577c20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.018056:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9baef59600/0x7ad3e1a879577c20 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851162.018081:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf041500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019696768:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851162.018151:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851162.018186:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbccfed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788851162.020520:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019696768 00000100:00100000:0.0:1788851162.020534:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019696768 00000100:00100000:0.0:1788851162.020611:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788851162.020622:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+10:14370:x1875746019696768:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851162.020642:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851162.020662:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a879577c27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577c20 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851162.020688:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a879577c27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577c20 expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851162.020699:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a879577c27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577c20 expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851162.020708:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6000, rc 0) 00000100:00100000:0.0:1788851162.020832:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:14370:x1875746019696768:12345-0@lo:101:mount.lustre.0 Request processed in 212us (2680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851162.020839:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851162.020848:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf041500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019696768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851162.020868:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9baef59600/0x7ad3e1a879577c20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c27 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851162.020878:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9baef59600/0x7ad3e1a879577c20 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577c27 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851162.020947:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019696896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851162.020982:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851162.021020:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87d6d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851162.021074:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019696896 00000100:00100000:0.0:1788851162.021078:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019696896 00000100:00100000:0.0:1788851162.021094:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788851162.021098:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:14370:x1875746019696896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851162.021458:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:14370:x1875746019696896:12345-0@lo:501:mount.lustre.0 Request processed in 358us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851162.021474:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788851162.021614:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019696896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851162.021641:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019697024:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851162.021686:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851162.021711:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87d6d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788851162.021852:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697024 00000100:00100000:1.0:1788851162.021865:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697024 00000100:00100000:1.0:1788851162.021901:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788851162.021908:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:14370:x1875746019697024:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851162.022063:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:14370:x1875746019697024:12345-0@lo:503:mount.lustre.0 Request processed in 155us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851162.022069:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788851162.022097:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019697024:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851162.024033:0:14414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf041f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14414:1875746019697152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851162.024112:0:14414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851162.024165:0:14414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbccfed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788851162.024172:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697152 00000100:00100000:0.0:1788851162.024179:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697152 00000100:00100000:0.0:1788851162.024220:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788851162.024228:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:14414:x1875746019697152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851162.024455:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:14414:x1875746019697152:12345-0@lo:502:llog_process_th.0 Request processed in 226us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851162.024464:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788851162.024494:0:14414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf041f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14414:1875746019697152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788851162.024530:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851162.024539:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851162.024542:0:14414:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788851162.024550:0:14414:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a9b929b7800 00000020:00000080:1.0:1788851162.024553:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788851162.024561:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851162.024564:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851162.024565:0:14414:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788851162.024568:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851162.024570:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851162.024571:0:14414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788851162.024586:0:14414:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a9b929b7800 00000020:00000080:1.0:1788851162.024588:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788851162.024647:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851162.024651:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851162.024652:0:14414:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788851162.024655:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851162.024657:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851162.024659:0:14414:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788851162.024662:0:14414:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a9b929b7800 00000020:00000080:1.0:1788851162.024664:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788851162.024700:0:14414:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf041f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14414:1875746019697280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851162.024735:0:14414:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851162.024767:0:14414:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bbccfed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788851162.024905:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697280 00000100:00100000:2.0:1788851162.024910:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697280 00000100:00100000:2.0:1788851162.024949:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788851162.024957:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:14414:x1875746019697280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851162.025113:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:14414:x1875746019697280:12345-0@lo:502:llog_process_th.0 Request processed in 157us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851162.025129:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788851162.025236:0:14414:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf041f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14414:1875746019697280:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788851162.025268:0:14414:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788851162.025274:0:14414:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788851162.025276:0:14414:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788851162.025280:0:14414:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788851162.025449:0:14370:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788851162.025468:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788851162.025527:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9baef59600/0x7ad3e1a879577c20 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c27 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851162.025540:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9baef59600/0x7ad3e1a879577c20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c27 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851162.025596:0:14370:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788851162.025599:0:14370:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a9b929b7800 10000000:01000000:2.0:1788851162.025602:0:14370:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a9b929b7800 10000000:01000000:2.0:1788851162.025607:0:14370:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788851162.025613:0:14370:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a9b929b7800 from 1 10000000:01000000:2.0:1788851162.025615:0:14370:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788851162.025643:0:14370:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90546e00/0x7ad3e1a879577c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851162.025651:0:14370:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b90546e00/0x7ad3e1a879577c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851162.025659:0:14370:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b90546e00/0x7ad3e1a879577c2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851162.025674:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019697408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788851162.025713:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851162.025739:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87d6d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788851162.026040:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697408 00000100:00100000:1.0:1788851162.026046:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697408 00000100:00100000:1.0:1788851162.026084:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788851162.026093:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:14370:x1875746019697408:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851162.026102:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851162.026130:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9baef59200/0x7ad3e1a879577c35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577c2e expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.026208:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9baef59200/0x7ad3e1a879577c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577c2e expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.026220:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9baef59200/0x7ad3e1a879577c35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577c2e expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.026230:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59200, rc 0) 00000100:00100000:1.0:1788851162.026276:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14370:x1875746019697408:12345-0@lo:101:mount.lustre.0 Request processed in 184us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851162.026283:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788851162.026939:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019697408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851162.026969:0:14370:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b90546e00/0x7ad3e1a879577c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c35 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851162.026987:0:14370:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b90546e00/0x7ad3e1a879577c2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577c35 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851162.027048:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019697536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851162.027088:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851162.027126:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87d6d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788851162.027225:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697536 00000100:00100000:1.0:1788851162.027231:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697536 00000100:00100000:1.0:1788851162.027264:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788851162.027272:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14370:x1875746019697536:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851162.028255:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14370:x1875746019697536:12345-0@lo:501:mount.lustre.0 Request processed in 979us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851162.028266:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788851162.028347:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019697536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851162.028399:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019697664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851162.028877:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851162.028897:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697664 00000100:00100000:1.0:1788851162.028903:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697664 00000100:00100000:1.0:1788851162.028937:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788851162.028945:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14370:x1875746019697664:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851162.029014:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87d6d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788851162.029138:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14370:x1875746019697664:12345-0@lo:503:mount.lustre.0 Request processed in 192us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851162.029145:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788851162.029419:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019697664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851162.030162:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf043100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14416:1875746019697792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851162.030219:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851162.030252:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b90422f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788851162.030481:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697792 00000100:00100000:0.0:1788851162.030487:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697792 00000100:00100000:0.0:1788851162.030584:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788851162.030595:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14416:x1875746019697792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788851162.030832:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14416:x1875746019697792:12345-0@lo:502:llog_process_th.0 Request processed in 238us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851162.030840:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788851162.034995:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf043100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14416:1875746019697792:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788851162.035076:0:14416:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788851162.035096:0:14416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8a9bb3f3b380) 00000020:00000080:0.0:1788851162.035121:0:14416:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788851162.035220:0:14416:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a9b929b7800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788851162.035229:0:14416:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a9b929b7800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788851162.035232:0:14416:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a9b929b7800 4 00010000:00080000:0.0:1788851162.035264:0:14416:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a9b8bdb3800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.106@tcp at head 00010000:00010000:0.0:1788851162.049035:0:14416:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788851162.049304:0:14416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788851162.049427:0:14416:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788851162.049443:0:14416:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7ad3e1a879577c43 00000100:00080000:0.0:1788851162.049453:0:14416:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788851162.049467:0:14416:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a9b8bdb3800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1788851162.049506:0:14416:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9b8bcf0e00 x1875746019697920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788851162.049542:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875746019697920:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788851162.049628:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788851162.049693:0:14416:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788851162.050149:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019697920 00000100:00100000:2.0:1788851162.050158:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019697920 00000100:00100000:2.0:1788851162.050329:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788851162.050337:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875746019697920:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788851162.050401:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875746019697920:12345-0@lo:38:llog_process_th.0 Request processed in 63us (772us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788851162.050409:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788851162.050479:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788851162.050487:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b8bdb3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851162.050491:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788851162.050495:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875746019697920:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788851162.052387:0:14416:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14416:1875746019698048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788851162.052477:0:14416:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851162.052514:0:14416:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87d6d480 going to sleep for 11 seconds 00000100:00100000:1.0:1788851162.053020:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698048 00000100:00100000:1.0:1788851162.053029:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698048 00000100:00100000:1.0:1788851162.053076:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788851162.053085:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14416:x1875746019698048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788851162.053342:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14416:x1875746019698048:12345-0@lo:502:llog_process_th.0 Request processed in 257us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851162.053350:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788851162.053408:0:14416:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14416:1875746019698048:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788851162.053437:0:14416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788851162.057297:0:14370:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788851162.057337:0:14370:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788851162.057367:0:14370:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90546e00/0x7ad3e1a879577c2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c35 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851162.057379:0:14370:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b90546e00/0x7ad3e1a879577c2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c35 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788851162.057430:0:14370:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788851162.057432:0:14370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788851162.057433:0:14370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851162.057435:0:14370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851162.057436:0:14370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851162.057438:0:14370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851162.057439:0:14370:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788851162.057440:0:14370:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788851162.057442:0:14370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851162.057443:0:14370:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788851162.057447:0:14370:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788851162.057450:0:14370:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788851162.057451:0:14370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788851162.057452:0:14370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851162.057453:0:14370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851162.057454:0:14370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851162.057455:0:14370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851162.057456:0:14370:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788851162.057457:0:14370:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788851162.057459:0:14370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851162.057460:0:14370:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788851162.057486:0:14370:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788851162.057507:0:14370:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019698176:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788851162.057595:0:14370:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851162.057623:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698176 00000100:00100000:0.0:1788851162.057633:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698176 00000100:00100000:2.0:1788851162.057637:0:14370:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87d6d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851162.057678:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788851162.057687:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14370:x1875746019698176:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788851162.058737:0:14380:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788851162.058754:0:14380:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788851162.199168:0:14380:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788851162.199208:0:14380:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788851162.199663:0:14404:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788851162.199668:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788851162.199690:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577c4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851162.199709:0:14404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879577c19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577c12 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851162.199718:0:14404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577c4a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851162.199759:0:14404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879577c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879577c12 expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851162.199773:0:14404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879577c19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879577c12 expref: 12 pid: 14380 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851162.199821:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4168a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14404:1875746019698304:0@lo:104: 00000100:00100000:2.0:1788851162.199884:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851162.199933:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87d6d300 going to sleep for 11 seconds 00000100:00100000:3.0:1788851162.200052:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698304 00000100:00100000:3.0:1788851162.200060:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698304 00000100:00100000:3.0:1788851162.200109:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788851162.200119:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4169180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+3:14404:x1875746019698304:12345-0@lo:104: 00010000:00010000:3.0:1788851162.200145:0:14371:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9baef58600/0x7ad3e1a879577c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879577c19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851162.200203:0:14371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788851162.200209:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4169180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+3:14404:x1875746019698304:12345-0@lo:104: Request processed in 92us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851162.200216:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788851162.200236:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851162.200242:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9baef58600/0x7ad3e1a879577c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879577c19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851162.200249:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58600 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:3.0:1788851162.200253:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9baef58600/0x7ad3e1a879577c12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879577c19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851162.200262:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9baef58600/0x7ad3e1a879577c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879577c19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851162.200269:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9baef58600/0x7ad3e1a879577c12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879577c19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851162.200287:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788851162.200318:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9baef58600/0x7ad3e1a879577c12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577c19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851162.200324:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851162.200351:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9baef58600/0x7ad3e1a879577c12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577c19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851162.200358:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9baef58600/0x7ad3e1a879577c12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577c19 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851162.200374:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851162.200376:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851162.200378:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851162.200410:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3309:1875746019698432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851162.200442:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851162.201350:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698432 00000100:00100000:1.0:1788851162.201357:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698432 00000100:00100000:3.0:1788851162.201363:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4168a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14404:1875746019698304:0@lo:104: 00010000:00010000:1.0:1788851162.201384:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879577c19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879577c12 expref: 13 pid: 14380 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851162.201388:0:14404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577c4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851162.201417:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788851162.201427:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+13:3309:x1875746019698432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851162.201439:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851162.201443:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879577c19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879577c12 expref: 13 pid: 14380 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.201454:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879577c19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879577c12 expref: 13 pid: 14380 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.201468:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af6200/0x7ad3e1a879577c19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879577c12 expref: 13 pid: 14380 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.201493:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577c4a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.201501:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577c4a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788851162.201515:0:14373:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001847399s 00010000:00010000:1.0:1788851162.201519:0:14373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577c4a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.201526:0:14373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577c4a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.201533:0:14373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577c4a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.201539:0:14373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577c4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.201545:0:14373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546800 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851162.201549:0:14373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577c4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.201556:0:14373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577c4a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.201584:0:14373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577c4a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851162.201595:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851162.201656:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:3309:x1875746019698432:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851162.201663:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788851162.201825:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3309:1875746019698432:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851162.201893:0:14404:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577c4a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851162.201901:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577c4a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851162.201907:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577c4a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851162.225163:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:14370:x1875746019698176:12345-0@lo:253:mount.lustre.0 Request processed in 167466us (167558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851162.225180:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788851162.225344:0:14370:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14370:1875746019698176:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788851162.225360:0:14370:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788851162.225364:0:14370:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788851162.225366:0:14370:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788851162.225368:0:14370:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851162.225369:0:14370:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851162.225370:0:14370:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851162.225372:0:14370:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851162.225373:0:14370:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788851162.225374:0:14370:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788851162.225376:0:14370:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851162.225388:0:14370:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788851162.225402:0:14370:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788851162.245268:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788851162.245631:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788851162.245963:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788851162.247687:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788851162.248695:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788851162.250350:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788851162.271391:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788851162.272402:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788851162.273662:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788851162.274365:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788851162.274686:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788851162.274880:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788851162.373681:0:14370:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788851162.374114:0:14370:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788851162.374431:0:14428:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788851162.375943:0:14370:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788851162.376058:0:14370:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788851162.376623:0:14428:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788851162.378368:0:14370:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000020:00080000:0.0:1788851162.380222:0:14427:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788851162.380230:0:14427:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1788851162.380390:0:14428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788851162.380600:0:14428:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788851162.380605:0:14428:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788851162.381890:0:14370:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788851162.382325:0:14370:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788851162.383757:0:14370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788851162.384863:0:14370:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788851162.384914:0:14370:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788851162.386874:0:14370:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788851162.393171:0:14370:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788851162.465957:0:14370:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788851162.465998:0:14370:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9708417df988 00100000:10000000:3.0:1788851162.466006:0:14370:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788851162.467562:0:14370:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788851162.467589:0:14370:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788851162.467608:0:14370:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788851162.467626:0:14370:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1788851162.642028:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788851162.961850:0:14385:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788851162.961858:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a9b929b7800 from 6 10000000:01000000:3.0:1788851162.961864:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788851162.961919:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a879577c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851162.961932:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a879577c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851162.961943:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a879577c51 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851162.961969:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019698560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788851162.962063:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851162.962140:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8be34cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851162.962325:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698560 00000100:00100000:2.0:1788851162.962333:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698560 00000100:00100000:2.0:1788851162.962390:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788851162.962399:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:14385:x1875746019698560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851162.962412:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851162.962440:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b90547400/0x7ad3e1a879577c58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577c51 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851162.962466:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90547400/0x7ad3e1a879577c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577c51 expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851162.962477:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b90547400/0x7ad3e1a879577c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577c51 expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851162.962487:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547400, rc 0) 00000100:00100000:2.0:1788851162.962533:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14385:x1875746019698560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851162.962539:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788851162.962718:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019698560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851162.962735:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a879577c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c58 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851162.962744:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a879577c51 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577c58 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851162.962841:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019698688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788851162.962877:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851162.962892:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905d9a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788851162.963031:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698688 00000100:00100000:2.0:1788851162.963037:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698688 00000100:00100000:2.0:1788851162.963070:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788851162.963084:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14385:x1875746019698688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788851162.963100:0:14380:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788851162.963116:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788851162.963120:0:14380:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788851162.963209:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14385:x1875746019698688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851162.963217:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788851162.963406:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019698688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788851162.963462:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788851162.963469:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a879577c51 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c58 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851162.963479:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a879577c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c58 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788851163.091184:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788851163.666359:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851164.114580:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788851164.690165:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851165.713916:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851166.738894:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851167.250777:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:1.0:1788851167.250832:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851167.250837:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851167.250841:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851167.250844:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788851167.250847:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788851167.250851:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788851167.250855:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a9b8bdb3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851167.250869:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8a9b8bdb3800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1788851167.250891:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9baf041c00 x1875746019698944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851167.250954:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875746019698944:0@lo:38:kworker.0 00000100:00100000:3.0:1788851167.251031:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851167.251096:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3311:1875746019698816:0@lo:400:kworker.0 00000100:00100000:2.0:1788851167.251132:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851167.251209:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698944 00000100:00100000:1.0:1788851167.251217:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698944 00000100:00100000:1.0:1788851167.251274:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788851167.251284:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1875746019698944:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788851167.251293:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019698816 00000100:00100000:3.0:1788851167.251300:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019698816 00010000:00080000:1.0:1788851167.251311:0:14390:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 500 last 0 00000100:00100000:3.0:1788851167.251344:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000020:00000080:1.0:1788851167.251353:0:14390:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7ad3e1a879577c5f 00000100:00100000:3.0:1788851167.251354:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:3311:x1875746019698816:12345-0@lo:400:kworker.0 00000004:00100000:1.0:1788851167.251372:0:14390:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788851167.251687:0:14390:0:(import.c:65:import_set_state_nolock()) ffff8a9b86655800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851167.251733:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875746019698944:12345-0@lo:38:kworker.0 Request processed in 450us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851167.251750:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788851167.251993:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:3311:x1875746019698816:12345-0@lo:400:kworker.0 Request processed in 640us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851167.252001:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788851167.252052:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a9baf041c00 x1875746019698944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788851177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851167.252063:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3311:1875746019698816:0@lo:400:kworker.0 00000100:00080000:3.0:1788851167.252069:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788851167.252078:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788851167.252083:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788851167.252086:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b8bdb3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788851167.252092:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875746019698944:0@lo:38:kworker.0 00000001:02000400:2.0:1788851167.500987:0:14671:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788851167.762849:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851168.788214:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851169.810380:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851170.836293:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851171.351022:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851161/real 1788851161] req@ffff8a9baf040000 x1875746019696128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851171 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851171.351055:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a9baf040000 x1875746019696128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851171 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788851171.351077:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b91a59800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851171.351101:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788851171.351105:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019696128:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788851171.351321:0:12292:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851171.351326:0:12292:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788851171.351330:0:12292:0:(import.c:65:import_set_state_nolock()) ffff8a9b91a59800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851171.351335:0:12292:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:2.0:1788851171.351340:0:12292:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788851171.351351:0:12292:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a9b91a59800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1788851171.351374:0:12292:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9bb4168380 x1875746019699200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788851171.351403:0:12292:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851171.351407:0:12292:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788851171.351443:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019699200:0@lo:8:kworker.0 00000400:00000100:2.0:1788851171.351506:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019699200 offset 0 length 520: 4 00000100:00100000:2.0:1788851171.351560:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019699328:0@lo:400:kworker.0 00000100:00100000:2.0:1788851171.351593:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851171.351640:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019699328 00000100:00100000:2.0:1788851171.351648:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019699328 00000100:00100000:2.0:1788851171.351692:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788851171.351701:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019699328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851171.351757:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4169c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019699328:12345-0@lo:400:kworker.0 Request processed in 56us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851171.351765:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788851171.351836:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a9bb416bb80 x1875746019699328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851171.351847:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019699328:0@lo:400:kworker.0 00000100:00100000:3.0:1788851171.351914:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3311:1875746019699072:0@lo:400:kworker.0 00000100:00100000:3.0:1788851171.351955:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851171.353913:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019699072 00000100:00100000:2.0:1788851171.353932:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019699072 00000100:00100000:2.0:1788851171.353994:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788851171.354006:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:3311:x1875746019699072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851171.354099:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:3311:x1875746019699072:12345-0@lo:400:kworker.0 Request processed in 95us (2142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851171.354105:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788851171.354162:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3311:1875746019699072:0@lo:400:kworker.0 00000020:00000080:0.0:1788851171.355961:0:14821:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd627b470 20000000:00000080:0.0:1788851171.356057:0:14821:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a9bb6456c00 uarg=0000000000000000 20000000:01000000:0.0:1788851171.356106:0:14821:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788851171.356114:0:14821:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788851171.356119:0:14821:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788851171.357937:0:14822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788851171.358173:0:14821:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788851171.371690:0:14821:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788851171.371740:0:14821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577c66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.372110:0:14821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a879577c27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577c20 expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.372122:0:14821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577c66 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.372170:0:14821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a879577c27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879577c20 expref: 11 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.372185:0:14821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a879577c27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879577c20 expref: 11 pid: 14380 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851171.372200:0:14821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14821:1875746019699456:0@lo:104: 00000100:00100000:2.0:1788851171.372271:0:14821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851171.372329:0:14821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bc18e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788851171.372419:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019699456 00000100:00100000:0.0:1788851171.372429:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019699456 00000100:00100000:0.0:1788851171.372484:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851171.372493:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+3:14821:x1875746019699456:12345-0@lo:104: 00010000:00010000:0.0:1788851171.372507:0:14372:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9baef59600/0x7ad3e1a879577c20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879577c27 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851171.372569:0:14372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788851171.372575:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+3:14821:x1875746019699456:12345-0@lo:104: Request processed in 84us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851171.372591:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788851171.372611:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851171.372616:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9baef59600/0x7ad3e1a879577c20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879577c27 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851171.372623:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59600 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:0.0:1788851171.372627:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9baef59600/0x7ad3e1a879577c20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879577c27 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851171.372635:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9baef59600/0x7ad3e1a879577c20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879577c27 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788851171.372641:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9baef59600/0x7ad3e1a879577c20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879577c27 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788851171.372646:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788851171.372684:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9baef59600/0x7ad3e1a879577c20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577c27 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851171.372690:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788851171.372710:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9baef59600/0x7ad3e1a879577c20 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577c27 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851171.372716:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9baef59600/0x7ad3e1a879577c20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577c27 expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851171.372733:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851171.372734:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851171.372736:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851171.372747:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3309:1875746019699584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851171.372776:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851171.374425:0:14821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14821:1875746019699456:0@lo:104: 00010000:00010000:2.0:1788851171.374455:0:14821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577c66 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851171.375133:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019699584 00000100:00100000:2.0:1788851171.375143:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019699584 00010000:00010000:2.0:1788851171.375176:0:14374:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a879577c27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879577c20 expref: 12 pid: 14380 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851171.375247:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788851171.375257:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:3309:x1875746019699584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788851171.375271:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851171.375276:0:14374:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a879577c27 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879577c20 expref: 12 pid: 14380 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.375302:0:14374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a879577c27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879577c20 expref: 12 pid: 14380 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.375322:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af6000/0x7ad3e1a879577c27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879577c20 expref: 12 pid: 14380 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.375350:0:14374:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577c66 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.375361:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577c66 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.375382:0:14374:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577c66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.375391:0:14374:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577c66 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.375409:0:14374:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577c66 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.375418:0:14374:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577c66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.375425:0:14374:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90546400 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851171.375430:0:14374:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577c66 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.375439:0:14374:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577c66 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.375476:0:14374:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577c66 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851171.375488:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851171.375567:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:3309:x1875746019699584:12345-0@lo:103:ldlm_bl.0 Request processed in 311us (2789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851171.375585:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851171.375660:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3309:1875746019699584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851171.375692:0:14821:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577c66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851171.375700:0:14821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577c66 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851171.375706:0:14821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577c66 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851171.859952:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851172.369879:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851162/real 1788851162] req@ffff8a9baf041180 x1875746019696256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851172 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851172.369915:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a9baf041180 x1875746019696256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851172 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788851172.369938:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c33800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851172.369962:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788851172.369967:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019696256:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788851172.370154:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851172.370159:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788851172.370161:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788851172.370164:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788851172.370174:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c33800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788851172.370179:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 494 00000100:00080000:0.0:1788851172.370184:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788851172.370194:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a9b87c33800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1788851172.370226:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9b8bcf3100 x1875746019699840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788851172.370265:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019699968:0@lo:400:kworker.0 00000100:00100000:0.0:1788851172.370323:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851172.370382:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788851172.370389:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3311:1875746019699712:0@lo:400:kworker.0 00000100:00100000:0.0:1788851172.370420:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851172.370460:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019699968 00000100:00100000:0.0:1788851172.370467:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019699968 00000100:00100000:0.0:1788851172.370526:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851172.370535:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019699968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851172.370586:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019699968:12345-0@lo:400:kworker.0 Request processed in 52us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851172.370592:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851172.370615:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019699712 00000100:00100000:0.0:1788851172.370619:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019699712 00000100:00100000:0.0:1788851172.370643:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788851172.370649:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:3311:x1875746019699712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851172.370677:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:3311:x1875746019699712:12345-0@lo:400:kworker.0 Request processed in 28us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851172.370684:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788851172.370719:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019699840:0@lo:8:kworker.0 00000400:00000100:0.0:1788851172.370748:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875746019699840 offset 0 length 520: 4 00000100:00100000:0.0:1788851172.370804:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3311:1875746019699712:0@lo:400:kworker.0 00010000:00080000:0.0:1788851172.370819:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a9b8bcf2300 x1875746019699968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851172.370969:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019699968:0@lo:400:kworker.0 00010000:00010000:0.0:1788851172.882683:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788851173.330070:0:14385:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788851173.330079:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9b929b7800 from 10 10000000:01000000:2.0:1788851173.330084:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788851173.330136:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879577c6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851173.330150:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879577c6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851173.330162:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879577c6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851173.330191:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019700096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788851173.330303:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851173.330389:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b9864d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788851173.330456:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700096 00000100:00100000:3.0:1788851173.330466:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700096 00000100:00100000:3.0:1788851173.330534:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788851173.330545:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+11:14385:x1875746019700096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851173.330569:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851173.330582:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b814a4400/0x7ad3e1a879577c74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577c6d expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851173.330605:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b814a4400/0x7ad3e1a879577c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577c6d expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851173.330616:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b814a4400/0x7ad3e1a879577c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577c6d expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851173.330624:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b814a4400, rc 0) 00000100:00100000:3.0:1788851173.330674:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14385:x1875746019700096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851173.330681:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788851173.334881:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019700096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851173.334916:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879577c6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c74 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851173.334931:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879577c6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577c74 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851173.335030:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019700224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851173.335097:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851173.335147:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b9864d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788851173.335241:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700224 00000100:00100000:3.0:1788851173.335250:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700224 00000100:00100000:3.0:1788851173.335308:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788851173.335318:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14385:x1875746019700224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851173.335774:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14385:x1875746019700224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 456us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851173.335818:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788851173.340347:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019700224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851173.340459:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019700352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851173.340548:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851173.340601:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b90422a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788851173.341201:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700352 00000100:00100000:0.0:1788851173.341211:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700352 00000100:00100000:0.0:1788851173.341274:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788851173.341285:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14385:x1875746019700352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788851173.341650:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:14385:x1875746019700352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 366us (1101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851173.341658:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788851173.342703:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019700352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788851173.346465:0:14883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788851173.346815:0:14385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788851173.346843:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788851173.346855:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879577c6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c74 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851173.346869:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879577c6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c74 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851173.909002:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788851174.356503:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788851174.932895:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851175.954405:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851176.979956:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788851177.044947:0:15071:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788851177.044951:0:15071:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788851177.045091:0:15071:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a9bb45ff800 00000020:01000004:2.0:1788851177.045107:0:15071:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788851177.045118:0:15071:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788851177.045132:0:15071:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8a9bc1e10000) 00000020:00000080:2.0:1788851177.045146:0:15071:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788851177.080714:0:15071:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788851177.081154:0:15071:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788851177.082041:0:15071:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788851177.082261:0:15071:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788851177.082470:0:15071:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788851177.082760:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 551: rc = 0 00100000:10000000:3.0:1788851177.083119:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 551: rc = 0 00100000:10000000:3.0:1788851177.083220:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 551: rc = 0 00100000:10000000:3.0:1788851177.083656:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 489: rc = 0 00100000:10000000:3.0:1788851177.084052:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 489: rc = 0 00100000:10000000:3.0:1788851177.084320:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 489: rc = 0 00100000:10000000:3.0:1788851177.084848:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 489: rc = 0 00100000:10000000:3.0:1788851177.085096:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 489: rc = 0 00100000:10000000:3.0:1788851177.085369:0:15071:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 489: rc = 0 00000020:00000080:3.0:1788851177.086198:0:15071:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788851177.086212:0:15071:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788851177.086224:0:15071:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7ad3e1a879577c82 00000020:01000004:3.0:1788851177.086234:0:15071:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788851177.086257:0:15071:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.106@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788851177.086261:0:15071:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788851177.086267:0:15071:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788851177.086272:0:15071:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788851177.086360:0:15071:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8a9b98c94d40) 00000020:00000080:3.0:1788851177.086374:0:15071:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788851177.088046:0:15071:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788851177.088246:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788851177.088253:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788851177.089646:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788851177.089670:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788851177.090701:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788851177.090721:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788851177.093452:0:15071:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788851177.093630:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788851177.093639:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788851177.104648:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788851177.104664:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788851177.133209:0:15071:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788851177.135575:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788851177.135601:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788851177.141752:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788851177.141772:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788851177.143161:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788851177.143175:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788851177.145964:0:15071:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788851177.146235:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788851177.146243:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788851177.147416:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788851177.147426:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788851177.184631:0:15071:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788851177.185312:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788851177.185322:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788851177.188191:0:15071:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788851177.188208:0:15071:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788851177.188671:0:15071:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788851177.188695:0:15071:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788851177.188703:0:15071:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.106@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788851177.203645:0:15071:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788851177.203685:0:15071:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.106@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788851177.203693:0:15071:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788851177.203695:0:15071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788851177.203696:0:15071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851177.203698:0:15071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851177.203699:0:15071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851177.203700:0:15071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851177.203701:0:15071:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788851177.203702:0:15071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851177.203704:0:15071:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788851177.203707:0:15071:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788851177.203709:0:15071:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788851177.203711:0:15071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788851177.203712:0:15071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851177.203712:0:15071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851177.203713:0:15071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851177.203714:0:15071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851177.203715:0:15071:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788851177.203716:0:15071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851177.203716:0:15071:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788851177.203743:0:15071:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788851177.203764:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019700480:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788851177.204051:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851177.204156:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b9864de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851177.204229:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700480 00000100:00100000:3.0:1788851177.204237:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700480 00000100:00100000:3.0:1788851177.204330:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788851177.204341:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:15071:x1875746019700480:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788851177.204373:0:14383:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788851177.204377:0:14383:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788851177.204381:0:14383:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788851177.213639:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:15071:x1875746019700480:12345-0@lo:253:mount.lustre.0 Request processed in 9291us (9578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851177.213653:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788851177.213819:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019700480:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788851177.213835:0:15071:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788851177.213838:0:15071:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788851177.213840:0:15071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788851177.213841:0:15071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851177.213843:0:15071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851177.213844:0:15071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851177.213933:0:15071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851177.213934:0:15071:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788851177.213936:0:15071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851177.213938:0:15071:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788851177.213961:0:15071:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a9bb45ff800 from lustre-OST0000 10000000:01000000:3.0:1788851177.214057:0:15071:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788851177.214060:0:15071:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788851177.214068:0:15071:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a9b98d10000 local copy 00010000:00010000:3.0:1788851177.214079:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547000/0x7ad3e1a879577b78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577b7f expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851177.214314:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019700608:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851177.214356:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851177.214441:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc29a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788851177.214490:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700608 00000100:00100000:0.0:1788851177.214497:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700608 00000100:00100000:0.0:1788851177.214577:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788851177.214587:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:15071:x1875746019700608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851177.214834:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:15071:x1875746019700608:12345-0@lo:501:mount.lustre.0 Request processed in 249us (478us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788851177.214841:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788851177.215101:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019700608:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788851177.215116:0:15071:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788851177.215255:0:15071:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788851177.215262:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547000/0x7ad3e1a879577b78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577b7f expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.215273:0:15071:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b90547000/0x7ad3e1a879577b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577b7f expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851177.215315:0:15071:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a9bb45ff800 10000000:01000000:3.0:1788851177.215321:0:15071:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788851177.215326:0:15071:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8a9b98d10000 10000000:01000000:3.0:1788851177.215329:0:15071:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788851177.215332:0:15071:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8a9b98d10000 from 1 10000000:01000000:3.0:1788851177.215335:0:15071:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788851177.215359:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a879577c90 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.215375:0:15071:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a879577c90 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.215386:0:15071:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a879577c90 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851177.215402:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019700736:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788851177.215442:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851177.215544:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc29a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788851177.215623:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700736 00000100:00100000:2.0:1788851177.215629:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700736 00000100:00100000:2.0:1788851177.215654:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788851177.215661:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+12:15071:x1875746019700736:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851177.215681:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851177.215695:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b90547e00/0x7ad3e1a879577c97 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577c90 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.215737:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90547e00/0x7ad3e1a879577c97 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577c90 expref: 13 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.215748:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b90547e00/0x7ad3e1a879577c97 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577c90 expref: 13 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.215758:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547e00, rc 0) 00000100:00100000:2.0:1788851177.215810:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+13:15071:x1875746019700736:12345-0@lo:101:mount.lustre.0 Request processed in 149us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851177.215816:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788851177.216227:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019700736:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851177.216242:0:15071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a879577c90 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c97 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.216251:0:15071:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a879577c90 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577c97 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851177.216268:0:15071:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788851177.216294:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a879577c90 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c97 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.216303:0:15071:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5200/0x7ad3e1a879577c90 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577c97 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851177.216310:0:15071:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788851177.216315:0:15071:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788851177.216320:0:15071:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788851177.216323:0:15071:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788851177.216347:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879577c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.216353:0:15071:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879577c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.216360:0:15071:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879577c9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851177.216374:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019700864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788851177.216406:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851177.216428:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bc29a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788851177.216496:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700864 00000100:00100000:2.0:1788851177.216501:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700864 00000100:00100000:2.0:1788851177.216524:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788851177.216530:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+13:15071:x1875746019700864:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851177.216539:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851177.216548:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577ca5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577c9e expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.216564:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577c9e expref: 14 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.216571:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b90546800/0x7ad3e1a879577ca5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577c9e expref: 14 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.216577:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546800, rc 0) 00000100:00100000:2.0:1788851177.216657:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+14:15071:x1875746019700864:12345-0@lo:101:mount.lustre.0 Request processed in 126us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851177.216673:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788851177.217046:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019700864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851177.217058:0:15071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879577c9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577ca5 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.217066:0:15071:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879577c9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577ca5 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851177.218537:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788851177.220087:0:15071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788851177.220401:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788851177.220450:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788851177.220486:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788851177.220537:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788851177.220576:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788851177.220611:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788851177.220676:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788851177.220685:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788851177.221124:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019700992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851177.221205:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851177.221354:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9ba2796540 going to sleep for 11 seconds 00000100:00100000:2.0:1788851177.221397:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019700992 00000100:00100000:2.0:1788851177.221406:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019700992 00000100:00100000:2.0:1788851177.221501:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788851177.221511:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+14:15071:x1875746019700992:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851177.221912:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+14:15071:x1875746019700992:12345-0@lo:501:mount.lustre.0 Request processed in 401us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851177.221921:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788851177.222125:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019700992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851177.222162:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019701120:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851177.222205:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851177.222516:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9ba2796540 going to sleep for 11 seconds 00000100:00100000:0.0:1788851177.222590:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019701120 00000100:00100000:0.0:1788851177.222596:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019701120 00000100:00100000:0.0:1788851177.222623:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788851177.222630:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+14:15071:x1875746019701120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788851177.223184:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+14:15071:x1875746019701120:12345-0@lo:503:mount.lustre.0 Request processed in 551us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851177.223193:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788851177.223523:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019701120:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788851177.224148:0:15071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788851177.224221:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019701248:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851177.224276:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851177.224316:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b91a0c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788851177.224556:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019701248 00000100:00100000:0.0:1788851177.224562:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019701248 00000100:00100000:0.0:1788851177.224593:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788851177.224601:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+14:15071:x1875746019701248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851177.225071:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+14:15071:x1875746019701248:12345-0@lo:502:mount.lustre.0 Request processed in 470us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851177.225079:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788851177.225338:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019701248:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851177.225598:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788851177.225651:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788851177.225703:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788851177.226118:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788851177.226164:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788851177.226197:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788851177.226292:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788851177.226333:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788851177.226365:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788851177.226415:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788851177.226454:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788851177.226505:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788851177.226547:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019701376:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851177.226612:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851177.226652:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b91a0c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788851177.226740:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019701376 00000100:00100000:0.0:1788851177.226748:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019701376 00000100:00100000:0.0:1788851177.226818:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788851177.226828:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+14:15071:x1875746019701376:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851177.227292:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+14:15071:x1875746019701376:12345-0@lo:502:mount.lustre.0 Request processed in 452us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851177.227301:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788851177.227419:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019701376:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851177.227493:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788851177.227505:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788851177.228636:0:15085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788851177.228647:0:15085:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788851177.228654:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851177.228656:0:15085:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788851177.228661:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788851177.228677:0:15085:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8a9b98c919c0) 00000020:00000080:3.0:1788851177.228699:0:15085:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788851177.228705:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788851177.229144:0:15085:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a9bb45ff800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788851177.229154:0:15085:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788851177.229161:0:15085:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7ad3e1a879577cb3 00010000:00010000:3.0:1788851177.233715:0:15085:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788851177.234610:0:15085:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788851177.237414:0:15085:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788851177.238575:0:15085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788851177.238587:0:15085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851177.238594:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851177.238596:0:15085:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788851177.238600:0:15085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788851177.238604:0:15085:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788851177.238606:0:15085:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788851177.238607:0:15085:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788851177.238609:0:15085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788851177.238612:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851177.238613:0:15085:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788851177.238615:0:15085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851177.238619:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851177.238620:0:15085:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788851177.238622:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788851177.238624:0:15085:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788851177.238627:0:15085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851177.238629:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851177.238631:0:15085:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788851177.238633:0:15085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788851177.238635:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851177.238637:0:15085:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788851177.238649:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788851177.238710:0:15085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851177.238713:0:15085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851177.238715:0:15085:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788851177.238717:0:15085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788851177.238928:0:15071:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788851177.238957:0:15071:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788851177.238987:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879577c9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577ca5 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.238999:0:15071:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b814a5000/0x7ad3e1a879577c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577ca5 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851177.239007:0:15071:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9bb45ff800 from 1 10000000:01000000:3.0:1788851177.239011:0:15071:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788851177.239048:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879577cba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.239056:0:15071:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879577cba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.239075:0:15071:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879577cba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851177.239102:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019701504:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788851177.239177:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851177.239212:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b91a0cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851177.239354:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019701504 00000100:00100000:2.0:1788851177.239363:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019701504 00000100:00100000:2.0:1788851177.239409:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788851177.239418:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+14:15071:x1875746019701504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851177.239432:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851177.239444:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577cc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577cba expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.239469:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577cc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577cba expref: 15 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.239479:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577cc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577cba expref: 15 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.239487:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546400, rc 0) 00000100:00100000:2.0:1788851177.239527:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+15:15071:x1875746019701504:12345-0@lo:101:mount.lustre.0 Request processed in 109us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851177.239533:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788851177.239690:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019701504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788851177.239709:0:15071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879577cba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577cc1 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.239719:0:15071:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879577cba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577cc1 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851177.241393:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788851177.241901:0:15071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788851177.243887:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788851177.243987:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788851177.244066:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788851177.244075:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788851177.244182:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019701632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851177.244250:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851177.244304:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b91a0cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851177.245133:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019701632 00000100:00100000:2.0:1788851177.245143:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019701632 00000100:00100000:2.0:1788851177.245195:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788851177.245204:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+15:15071:x1875746019701632:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851177.245504:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+15:15071:x1875746019701632:12345-0@lo:501:mount.lustre.0 Request processed in 301us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851177.245522:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788851177.245621:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019701632:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851177.245681:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019701760:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788851177.245725:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851177.247991:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019701760 00000100:00100000:2.0:1788851177.248004:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019701760 00000100:00100000:2.0:1788851177.248052:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788851177.248061:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+15:15071:x1875746019701760:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851177.248289:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+15:15071:x1875746019701760:12345-0@lo:503:mount.lustre.0 Request processed in 217us (2551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851177.248298:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788851177.248361:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b90422cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851177.248386:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019701760:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788851177.248956:0:15071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788851177.249037:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019701888:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851177.249096:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851177.249121:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b9864de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788851177.249143:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019701888 00000100:00100000:2.0:1788851177.249147:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019701888 00000100:00100000:2.0:1788851177.249172:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788851177.249178:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+15:15071:x1875746019701888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851177.249341:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+15:15071:x1875746019701888:12345-0@lo:502:mount.lustre.0 Request processed in 161us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851177.249349:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788851177.249400:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019701888:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788851177.249627:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788851177.249680:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788851177.249747:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788851177.251584:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788851177.251654:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788851177.251726:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788851177.252178:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788851177.252215:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788851177.252269:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019702016:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851177.252364:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851177.252436:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b9864de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851177.254612:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702016 00000100:00100000:3.0:1788851177.254627:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702016 00000100:00100000:2.0:1788851177.254818:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788851177.254827:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+15:15071:x1875746019702016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851177.255315:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+15:15071:x1875746019702016:12345-0@lo:502:mount.lustre.0 Request processed in 487us (2949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851177.255324:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788851177.256201:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019702016:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788851177.256474:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788851177.256492:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788851177.258275:0:15089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851177.258300:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851177.258319:0:15089:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788851177.258327:0:15089:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a9bb45ff800 00000020:00000080:3.0:1788851177.258330:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788851177.258337:0:15089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851177.258340:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851177.258341:0:15089:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788851177.258344:0:15089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851177.258347:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851177.258348:0:15089:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788851177.258351:0:15089:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a9bb45ff800 00000020:00000080:3.0:1788851177.258353:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788851177.258445:0:15089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851177.258449:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851177.258451:0:15089:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788851177.258454:0:15089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851177.258457:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851177.258458:0:15089:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788851177.258462:0:15089:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a9bb45ff800 00000020:00000080:3.0:1788851177.258464:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788851177.262127:0:15089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788851177.262140:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788851177.262142:0:15089:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788851177.262148:0:15089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788851177.262220:0:15071:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788851177.262246:0:15071:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788851177.262262:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879577cba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577cc1 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.262275:0:15071:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879577cba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577cc1 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851177.262350:0:15071:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788851177.262353:0:15071:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a9bb45ff800 10000000:01000000:2.0:1788851177.262363:0:15071:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a9bb45ff800 10000000:01000000:2.0:1788851177.262367:0:15071:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788851177.262373:0:15071:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a9bb45ff800 from 1 10000000:01000000:2.0:1788851177.262375:0:15071:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788851177.262413:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547800/0x7ad3e1a879577cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.262422:0:15071:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b90547800/0x7ad3e1a879577cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.262433:0:15071:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b90547800/0x7ad3e1a879577cc8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851177.262472:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4168e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019702144:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788851177.262539:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851177.262575:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8696a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788851177.263742:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702144 00000100:00100000:2.0:1788851177.263754:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702144 00000100:00100000:2.0:1788851177.263819:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788851177.263829:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+15:15071:x1875746019702144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851177.263845:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851177.263995:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b90547c00/0x7ad3e1a879577ccf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577cc8 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.264023:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90547c00/0x7ad3e1a879577ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577cc8 expref: 16 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.264035:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b90547c00/0x7ad3e1a879577ccf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577cc8 expref: 16 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.264056:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547c00, rc 0) 00000100:00100000:2.0:1788851177.264123:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:15071:x1875746019702144:12345-0@lo:101:mount.lustre.0 Request processed in 295us (1584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851177.264130:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788851177.264188:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4168e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019702144:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851177.264204:0:15071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b90547800/0x7ad3e1a879577cc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577ccf expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.264213:0:15071:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b90547800/0x7ad3e1a879577cc8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577ccf expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788851177.266072:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788851177.266471:0:15071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788851177.266742:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788851177.266823:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788851177.267113:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788851177.269160:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788851177.269225:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788851177.269288:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788851177.269345:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788851177.269378:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788851177.269430:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788851177.269469:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788851177.269507:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788851177.269557:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788851177.269593:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788851177.269626:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788851177.269673:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788851177.269721:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788851177.273148:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788851177.273243:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788851177.273296:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788851177.273333:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788851177.273382:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788851177.273421:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788851177.273484:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788851177.273538:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788851177.273579:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788851177.273614:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788851177.273681:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788851177.273721:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788851177.276249:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788851177.276267:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788851177.276388:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4168e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019702272:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851177.276461:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851177.276512:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702272 00000100:00100000:2.0:1788851177.276520:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702272 00000100:00100000:2.0:1788851177.276564:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788851177.276573:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:15071:x1875746019702272:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851177.278879:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8696a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788851177.279270:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:15071:x1875746019702272:12345-0@lo:501:mount.lustre.0 Request processed in 2693us (2804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851177.279292:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788851177.281663:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4168e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019702272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851177.281767:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019702400:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851177.289104:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851177.289161:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b91a0c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851177.289955:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702400 00000100:00100000:3.0:1788851177.290042:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702400 00000100:00100000:3.0:1788851177.290106:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788851177.290117:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:15071:x1875746019702400:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851177.290366:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:15071:x1875746019702400:12345-0@lo:503:mount.lustre.0 Request processed in 250us (1272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851177.290375:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788851177.290494:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019702400:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788851177.291293:0:15071:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788851177.291371:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4169880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019702528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851177.291438:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851177.291474:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8696a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788851177.291562:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702528 00000100:00100000:3.0:1788851177.291574:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702528 00000100:00100000:3.0:1788851177.291616:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788851177.291624:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:15071:x1875746019702528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851177.294060:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:15071:x1875746019702528:12345-0@lo:502:mount.lustre.0 Request processed in 2427us (2612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851177.294073:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788851177.294257:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4169880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019702528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788851177.294573:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788851177.294632:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788851177.294658:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788851177.294699:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788851177.296605:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788851177.296720:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788851177.298307:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788851177.298352:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788851177.298422:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788851177.298460:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788851177.298488:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788851177.298534:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788851177.298572:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788851177.298607:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788851177.298654:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788851177.298689:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788851177.298723:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788851177.298814:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788851177.301132:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788851177.301593:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788851177.301692:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788851177.301942:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788851177.302089:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788851177.302145:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788851177.302184:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788851177.302239:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788851177.302320:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788851177.302358:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788851177.302402:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788851177.302455:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788851177.302494:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788851177.302527:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788851177.302562:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788851177.302612:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788851177.302649:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788851177.302710:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788851177.305193:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788851177.305253:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788851177.305362:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788851177.305401:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788851177.305453:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4169880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019702656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851177.305538:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851177.305586:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8696a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788851177.305955:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702656 00000100:00100000:3.0:1788851177.305975:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702656 00000100:00100000:3.0:1788851177.306026:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788851177.306036:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:15071:x1875746019702656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851177.306336:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:15071:x1875746019702656:12345-0@lo:502:mount.lustre.0 Request processed in 301us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851177.306346:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788851177.308102:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4169880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019702656:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788851177.308248:0:15071:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788851177.308264:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788851177.316402:0:15094:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788851177.316429:0:15094:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8a9bb5a04d40) 00000020:00000080:1.0:1788851177.316451:0:15094:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788851177.316517:0:15094:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a9bb45ff800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788851177.316521:0:15094:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a9bb45ff800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788851177.316529:0:15094:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a9bb45ff800 3 00010000:00080000:1.0:1788851177.316557:0:15094:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a9bb4291000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.106@tcp at head 00010000:00010000:1.0:1788851177.318177:0:15094:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1788851177.318392:0:15094:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788851177.318426:0:15094:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788851177.318439:0:15094:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7ad3e1a879577cdd 00000100:00080000:1.0:1788851177.318449:0:15094:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788851177.318461:0:15094:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8a9bb4291000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1788851177.318497:0:15094:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9baf040700 x1875746019702784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788851177.318522:0:15094:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788851177.320180:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875746019702784:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788851177.320253:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851177.320341:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702784 00000100:00100000:2.0:1788851177.320349:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702784 00000100:00100000:2.0:1788851177.320385:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788851177.320392:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875746019702784:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788851177.320418:0:14388:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:2.0:1788851177.320452:0:14388:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7ad3e1a879577ce4 00000004:00100000:2.0:1788851177.320467:0:14388:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788851177.320499:0:14388:0:(import.c:65:import_set_state_nolock()) ffff8a9bb45fb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851177.320562:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4169880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875746019702784:12345-0@lo:38:llog_process_th.0 Request processed in 169us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851177.320569:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788851177.320615:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a9baf040700 x1875746019702784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788851187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851177.320626:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788851177.320635:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788851177.320642:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788851177.320647:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788851177.320649:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9bb4291000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788851177.320654:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1875746019702784:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788851177.327391:0:15094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:2.0:1788851177.328077:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851177.328084:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788851177.328086:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851177.328090:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788851177.328166:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000020:01000000:2.0:1788851177.328202:0:15071:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788851177.328233:0:15071:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788851177.328250:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547800/0x7ad3e1a879577cc8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577ccf expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.328262:0:15071:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b90547800/0x7ad3e1a879577cc8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577ccf expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788851177.328336:0:15071:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788851177.328338:0:15071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788851177.328340:0:15071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851177.328347:0:15071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851177.328348:0:15071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851177.328349:0:15071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851177.328350:0:15071:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788851177.328351:0:15071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851177.328352:0:15071:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788851177.328356:0:15071:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788851177.328358:0:15071:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788851177.328359:0:15071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788851177.328360:0:15071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851177.328360:0:15071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851177.328361:0:15071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851177.328362:0:15071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851177.328363:0:15071:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788851177.328363:0:15071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851177.328364:0:15071:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788851177.328379:0:15071:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788851177.328395:0:15071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019703040:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788851177.328471:0:15071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851177.328512:0:15071:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8696a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788851177.328580:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703040 00000100:00100000:3.0:1788851177.328588:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703040 00000100:00100000:3.0:1788851177.328642:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788851177.328651:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:15071:x1875746019703040:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788851177.328681:0:14383:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788851177.328696:0:14383:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788851177.336427:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4169f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019702912:0@lo:400:kworker.0 00000100:00100000:1.0:1788851177.336508:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851177.336605:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019702912 00000100:00100000:0.0:1788851177.336614:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019702912 00000100:00100000:0.0:1788851177.336668:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788851177.336678:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019702912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851177.336746:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf040e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875746019702912:12345-0@lo:400:kworker.0 Request processed in 70us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851177.336765:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788851177.336877:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8a9bb4169f80 x1875746019702912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851177.336890:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4169f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875746019702912:0@lo:400:kworker.0 20000000:01000000:3.0:1788851177.356208:0:14383:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788851177.356257:0:14383:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788851177.356949:0:14404:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788851177.356956:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788851177.357050:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577ceb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851177.357069:0:14404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b90547400/0x7ad3e1a879577c58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577c51 expref: 16 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851177.357078:0:14404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577ceb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851177.357118:0:14404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b90547400/0x7ad3e1a879577c58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879577c51 expref: 16 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851177.357132:0:14404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9b90547400/0x7ad3e1a879577c58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879577c51 expref: 16 pid: 14382 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851177.357147:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14404:1875746019703168:0@lo:104: 00000100:00100000:0.0:1788851177.357207:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851177.357256:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9a8251fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851177.357335:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703168 00000100:00100000:2.0:1788851177.357343:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703168 00000100:00100000:2.0:1788851177.357394:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788851177.357403:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+3:14404:x1875746019703168:12345-0@lo:104: 00010000:00010000:2.0:1788851177.357416:0:14372:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a879577c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879577c58 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851177.357471:0:14372:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788851177.357477:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+3:14404:x1875746019703168:12345-0@lo:104: Request processed in 76us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851177.357484:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788851177.357544:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851177.357551:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a879577c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879577c58 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.357558:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4e00 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:3.0:1788851177.357561:0:14376:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a879577c51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879577c58 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.357586:0:14376:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a879577c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879577c58 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851177.357593:0:14376:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a879577c51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879577c58 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851177.357598:0:14376:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788851177.357633:0:14376:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a879577c51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577c58 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.357639:0:14376:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851177.357660:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a879577c51 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577c58 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.357667:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4e00/0x7ad3e1a879577c51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577c58 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.357684:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851177.357686:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851177.357688:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851177.357695:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851177.357706:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3308:1875746019703296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851177.357829:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851177.357868:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703296 00000100:00100000:3.0:1788851177.357872:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703296 00010000:00010000:3.0:1788851177.357891:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b90547400/0x7ad3e1a879577c58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879577c51 expref: 17 pid: 14382 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851177.357913:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788851177.357926:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:3308:x1875746019703296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851177.357936:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851177.357942:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b90547400/0x7ad3e1a879577c58 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879577c51 expref: 17 pid: 14382 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.357951:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b90547400/0x7ad3e1a879577c58 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879577c51 expref: 17 pid: 14382 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.358039:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577ceb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.358049:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577ceb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788851177.358063:0:14375:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001847399s 00010000:00010000:3.0:1788851177.358067:0:14375:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577ceb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.358073:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577ceb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.358079:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577ceb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.358085:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577ceb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.358089:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851177.358093:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577ceb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.358110:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577ceb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.358119:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577ceb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851177.358131:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851177.358159:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:3308:x1875746019703296:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851177.358165:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788851177.358199:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3308:1875746019703296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851177.358327:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b90547400/0x7ad3e1a879577c58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879577c51 expref: 16 pid: 14382 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851177.358338:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14404:1875746019703168:0@lo:104: 00010000:00010000:0.0:1788851177.358362:0:14404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577ceb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851177.358370:0:14404:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577ceb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851177.358375:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577ceb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851177.358381:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577ceb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851177.368323:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+15:15071:x1875746019703040:12345-0@lo:253:mount.lustre.0 Request processed in 39661us (39840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851177.368340:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788851177.368540:0:15071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15071:1875746019703040:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788851177.368556:0:15071:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788851177.368572:0:15071:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788851177.368574:0:15071:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788851177.368576:0:15071:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851177.368577:0:15071:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851177.368579:0:15071:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851177.368580:0:15071:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851177.368581:0:15071:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788851177.368583:0:15071:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851177.368584:0:15071:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788851177.368599:0:15071:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788851177.374551:0:15071:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788851177.374722:0:15071:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788851177.375562:0:15071:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788851177.375707:0:15071:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788851177.376029:0:15071:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788851177.376222:0:15071:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788851177.377227:0:15071:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788851177.441169:0:15071:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788851177.441179:0:15071:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788851177.441209:0:15071:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788851177.441269:0:15071:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.106@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788851177.441297:0:15071:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788851177.441326:0:15071:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788851178.001987:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788851178.961905:0:14385:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788851178.961914:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a9b929b7800 from 7 10000000:01000000:2.0:1788851178.961919:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788851178.961960:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547400/0x7ad3e1a879577cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851178.961973:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b90547400/0x7ad3e1a879577cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851178.961984:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b90547400/0x7ad3e1a879577cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851178.962009:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019703424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788851178.962078:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851178.962136:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8696a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788851178.962162:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703424 00000100:00100000:2.0:1788851178.962170:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703424 00000100:00100000:2.0:1788851178.962222:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788851178.962232:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+15:14385:x1875746019703424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851178.962256:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851178.962271:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577cf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577cf2 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851178.962307:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577cf2 expref: 16 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851178.962318:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577cf2 expref: 16 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851178.962327:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547200, rc 0) 00000100:00100000:2.0:1788851178.962376:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:14385:x1875746019703424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851178.962384:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788851178.962438:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019703424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851178.962453:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b90547400/0x7ad3e1a879577cf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577cf9 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851178.962462:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b90547400/0x7ad3e1a879577cf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577cf9 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851178.962508:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019703552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788851178.962537:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851178.962551:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8696a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788851178.963293:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703552 00000100:00100000:0.0:1788851178.964475:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703552 00000100:00100000:1.0:1788851178.964600:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788851178.964611:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:14385:x1875746019703552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788851178.964636:0:14383:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788851178.964654:0:14383:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788851178.964658:0:14383:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788851178.964812:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:14385:x1875746019703552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 202us (2273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851178.964820:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788851178.964996:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019703552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788851178.965074:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788851178.965082:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547400/0x7ad3e1a879577cf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577cf9 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851178.965093:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b90547400/0x7ad3e1a879577cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577cf9 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851179.026002:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851180.051257:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851181.076167:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851182.106484:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788851182.614105:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851182.614114:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788851182.614118:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851182.614128:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788851182.614233:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3310:1875746019703680:0@lo:400:kworker.0 00000100:00100000:3.0:1788851182.614333:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851182.614400:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851182.614407:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019703808:0@lo:400:kworker.0 00000100:00100000:3.0:1788851182.614437:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851182.614477:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019703936:0@lo:400:kworker.0 00000100:00100000:3.0:1788851182.614509:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851182.614551:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703680 00000100:00100000:3.0:1788851182.614562:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703680 00000100:00100000:3.0:1788851182.614628:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788851182.614641:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:3310:x1875746019703680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851182.614703:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:3310:x1875746019703680:12345-0@lo:400:kworker.0 Request processed in 64us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851182.614710:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788851182.614756:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703808 00000100:00100000:3.0:1788851182.614760:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703808 00000100:00100000:3.0:1788851182.614803:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019703936 00000100:00100000:3.0:1788851182.614806:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019703936 00000100:00100000:3.0:1788851182.614834:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788851182.614840:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019703808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851182.614875:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019703808:12345-0@lo:400:kworker.0 Request processed in 35us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851182.614881:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788851182.614892:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788851182.614897:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019703936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851182.614936:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019703936:12345-0@lo:400:kworker.0 Request processed in 38us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851182.614942:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788851182.614986:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb45a4a80 x1875746019703808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851182.615002:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019703808:0@lo:400:kworker.0 00000100:00100000:3.0:1788851182.615011:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3310:1875746019703680:0@lo:400:kworker.0 00010000:00080000:3.0:1788851182.615040:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb45a5180 x1875746019703936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851182.615050:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019703936:0@lo:400:kworker.0 00000100:00080000:2.0:1788851182.615505:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788851183.124402:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851184.145967:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788851184.596103:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788851185.172033:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788851185.240977:0:15437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788851186.193917:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851186.514179:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851171/real 1788851171] req@ffff8a9bb4168380 x1875746019699200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851186 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851186.514212:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a9bb4168380 x1875746019699200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851186 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788851186.514234:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b91a59800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788851186.514266:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788851186.514271:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019699200:0@lo:8:kworker.0 00000100:00080000:3.0:1788851186.516798:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851186.516805:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788851186.516809:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a9b91a59800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851186.516816:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 504 00000100:00080000:3.0:1788851186.516822:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00100000:1.0:1788851186.516828:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3309:1875746019704064:0@lo:400:kworker.0 00000100:00080000:3.0:1788851186.516845:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8a9b91a59800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1788851186.516879:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9bb45a4700 x1875746019704192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788851186.516894:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851186.516898:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788851186.516911:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851186.516940:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019704320:0@lo:400:kworker.0 00000100:00100000:3.0:1788851186.516985:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851186.517016:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851186.517023:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019704448:0@lo:400:kworker.0 00000100:00100000:3.0:1788851186.517045:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851186.517077:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704320 00000100:00100000:3.0:1788851186.517085:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704320 00000100:00100000:3.0:1788851186.517137:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704448 00000100:00100000:3.0:1788851186.517141:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704448 00000100:00100000:3.0:1788851186.517164:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851186.517172:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019704320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851186.517218:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019704320:12345-0@lo:400:kworker.0 Request processed in 46us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851186.517225:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851186.517240:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851186.517246:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019704448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851186.517273:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019704448:12345-0@lo:400:kworker.0 Request processed in 27us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851186.517278:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788851186.517313:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb45a4380 x1875746019704448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851186.517338:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019704448:0@lo:400:kworker.0 00010000:00080000:3.0:1788851186.517352:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb45a4a80 x1875746019704320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851186.517359:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019704320:0@lo:400:kworker.0 00000100:00100000:3.0:1788851186.517384:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019704192:0@lo:8:kworker.0 00000100:00100000:3.0:1788851186.517414:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851186.517719:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704064 00000100:00100000:2.0:1788851186.517724:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704064 00000100:00100000:2.0:1788851186.517761:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788851186.517768:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:3309:x1875746019704064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851186.517838:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:3309:x1875746019704064:12345-0@lo:400:kworker.0 Request processed in 70us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851186.517844:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1788851186.517884:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851186.517902:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3309:1875746019704064:0@lo:400:kworker.0 00000100:00100000:1.0:1788851186.517938:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704192 00000100:00100000:1.0:1788851186.517948:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704192 00000100:00100000:1.0:1788851186.517981:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788851186.517986:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875746019704192:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788851186.518009:0:15072:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:1.0:1788851186.518040:0:15072:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ad3e1a879577d00 00002000:00100000:1.0:1788851186.518053:0:15072:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8a9bb4292800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788851186.518058:0:15072:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788851186.518060:0:15072:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788851186.518426:0:15072:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788851186.518450:0:15072:0:(import.c:65:import_set_state_nolock()) ffff8a9bb4292000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851186.518496:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1875746019704192:12345-0@lo:8:kworker.0 Request processed in 509us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851186.518502:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788851186.518544:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb45a4700 x1875746019704192/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788851206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851186.518553:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788851186.518560:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788851186.518568:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788851186.518573:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788851186.518575:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b91a59800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788851186.518588:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788851186.518592:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019704192:0@lo:8:kworker.0 00000004:00080000:1.0:1788851186.518641:0:14411:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788851186.518658:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14411:1875746019704704:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788851186.518666:0:14410:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788851186.518687:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851186.518703:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fbb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788851186.518722:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019704576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851186.518748:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851186.519032:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704704 00000100:00100000:2.0:1788851186.519038:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704704 00000004:00080000:3.0:1788851186.519051:0:14410:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 519460269053ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788851186.519072:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788851186.519091:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14411:x1875746019704704:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788851186.524476:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704576 00000100:00100000:0.0:1788851186.524492:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704576 00000100:00100000:0.0:1788851186.524552:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788851186.524563:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875746019704576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788851186.524600:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788851186.524692:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf041880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875746019704576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (5942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851186.524699:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788851186.524763:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9baf042680 x1875746019704576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851186.524800:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019704576:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788851186.526499:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1788851186.533372:0:15073:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788851186.533384:0:15073:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788851186.533391:0:15073:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1788851186.547590:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.547603:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.547622:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.547627:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.547634:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.547684:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.547696:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.547719:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.547743:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851186.547762:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851186.547768:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.547776:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4e00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851186.547816:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.547826:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.547843:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.547850:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.547868:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.547870:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.547872:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.548615:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.548632:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.548644:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.548648:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.548653:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.548663:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.548671:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.548677:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.548697:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851186.548711:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851186.548716:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.548723:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5800 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851186.548727:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.548735:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.548755:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.548762:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.548812:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.548814:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.548816:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.561229:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.561248:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577d15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.561269:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.561275:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.561282:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577d15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.561297:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577d15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.561308:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577d15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.561315:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577d15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.564343:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788851186.565033:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.565044:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d1c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.565060:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.565064:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.565070:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.565084:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.565094:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d1c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.565113:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.565302:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788851186.565311:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577d15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.565319:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5a00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851186.565323:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577d15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.565333:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577d15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.565356:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577d15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.565365:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577d15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.565400:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851186.565404:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.565410:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5400 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851186.565413:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.565421:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.565430:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.565437:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.565438:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.565440:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.568614:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788851186.568627:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851186.569285:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.569293:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.569313:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.569317:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.569323:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.569336:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.569347:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.569356:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.571386:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851186.571401:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.571415:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851186.571421:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.571433:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.571459:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.571469:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851186.571480:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851186.571482:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.576525:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788851186.576540:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.576592:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.577353:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.577363:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.577378:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.577383:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.577389:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.577411:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.577421:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.577430:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.577449:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851186.577461:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851186.577466:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.577474:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851186.577479:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.577487:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.577503:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.577510:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.577534:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.577536:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.577538:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.578159:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.578166:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d642e3d/0x7ad3e1a879577d31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578178:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.578181:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.578187:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d642e3d/0x7ad3e1a879577d31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578197:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d642e3d/0x7ad3e1a879577d31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578205:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002d642e3d/0x7ad3e1a879577d31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578211:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002d642e3d/0x7ad3e1a879577d31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578227:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851186.578238:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851186.578242:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002d642e3d/0x7ad3e1a879577d31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578261:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ec00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851186.578265:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002d642e3d/0x7ad3e1a879577d31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578275:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002d642e3d/0x7ad3e1a879577d31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578286:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002d642e3d/0x7ad3e1a879577d31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578293:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d642e3d/0x7ad3e1a879577d31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578306:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.578308:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.578309:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.578685:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.578691:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dd78ef9/0x7ad3e1a879577d38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578700:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.578703:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.578707:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dd78ef9/0x7ad3e1a879577d38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578717:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001dd78ef9/0x7ad3e1a879577d38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578729:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dd78ef9/0x7ad3e1a879577d38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578736:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001dd78ef9/0x7ad3e1a879577d38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578749:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851186.578757:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851186.578761:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001dd78ef9/0x7ad3e1a879577d38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578767:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ea00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851186.578770:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001dd78ef9/0x7ad3e1a879577d38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578778:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001dd78ef9/0x7ad3e1a879577d38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578811:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001dd78ef9/0x7ad3e1a879577d38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578818:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001dd78ef9/0x7ad3e1a879577d38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.578831:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.578836:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.578838:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.579260:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.579267:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049eeb978/0x7ad3e1a879577d3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.579275:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.579278:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.579283:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049eeb978/0x7ad3e1a879577d3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.579292:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049eeb978/0x7ad3e1a879577d3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.579300:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049eeb978/0x7ad3e1a879577d3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.579306:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049eeb978/0x7ad3e1a879577d3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.579320:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851186.579328:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851186.579333:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049eeb978/0x7ad3e1a879577d3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.579340:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168e000 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851186.579343:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049eeb978/0x7ad3e1a879577d3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.579362:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049eeb978/0x7ad3e1a879577d3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.579373:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049eeb978/0x7ad3e1a879577d3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.579379:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049eeb978/0x7ad3e1a879577d3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.579393:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.579394:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.579396:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.580631:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.580640:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d9a9381/0x7ad3e1a879577d46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.580653:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.580657:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.580662:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d9a9381/0x7ad3e1a879577d46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.580673:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d9a9381/0x7ad3e1a879577d46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.580681:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d9a9381/0x7ad3e1a879577d46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.580696:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d9a9381/0x7ad3e1a879577d46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.580765:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788851186.581305:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.581311:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c140c75/0x7ad3e1a879577d4d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.581321:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.581324:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.581329:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c140c75/0x7ad3e1a879577d4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.581338:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c140c75/0x7ad3e1a879577d4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.581345:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c140c75/0x7ad3e1a879577d4d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.581352:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c140c75/0x7ad3e1a879577d4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.581617:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788851186.581625:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d9a9381/0x7ad3e1a879577d46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.581633:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168e400 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851186.581638:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d9a9381/0x7ad3e1a879577d46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.581662:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d9a9381/0x7ad3e1a879577d46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.581683:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d9a9381/0x7ad3e1a879577d46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.581691:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d9a9381/0x7ad3e1a879577d46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.581729:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851186.581734:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c140c75/0x7ad3e1a879577d4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.581741:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f200 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851186.581744:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c140c75/0x7ad3e1a879577d4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.581752:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c140c75/0x7ad3e1a879577d4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.581762:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c140c75/0x7ad3e1a879577d4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.581770:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.581771:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.581778:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.581871:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788851186.581878:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c140c75/0x7ad3e1a879577d4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851186.582411:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.582417:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6b81590/0x7ad3e1a879577d54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.582427:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.582431:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.582436:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6b81590/0x7ad3e1a879577d54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.582445:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6b81590/0x7ad3e1a879577d54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.582454:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6b81590/0x7ad3e1a879577d54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.582461:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6b81590/0x7ad3e1a879577d54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.582481:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851186.582490:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851186.582494:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6b81590/0x7ad3e1a879577d54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.582500:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168fa00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851186.582503:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6b81590/0x7ad3e1a879577d54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.582517:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6b81590/0x7ad3e1a879577d54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.582530:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6b81590/0x7ad3e1a879577d54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.582536:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6b81590/0x7ad3e1a879577d54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.582550:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.582552:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.582553:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.582999:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.583005:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc7a39d/0x7ad3e1a879577d5b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.583015:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.583018:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.583022:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cc7a39d/0x7ad3e1a879577d5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.583031:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cc7a39d/0x7ad3e1a879577d5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.583039:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cc7a39d/0x7ad3e1a879577d5b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.583053:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cc7a39d/0x7ad3e1a879577d5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.583068:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851186.583093:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851186.583108:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cc7a39d/0x7ad3e1a879577d5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.583116:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168e600 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851186.583120:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc7a39d/0x7ad3e1a879577d5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.583128:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cc7a39d/0x7ad3e1a879577d5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.583140:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cc7a39d/0x7ad3e1a879577d5b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.583147:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cc7a39d/0x7ad3e1a879577d5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.583162:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.583164:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.583165:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.584015:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.584067:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.584085:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577d62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.584106:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.584110:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.584115:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577d62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.584126:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577d62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.584136:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577d62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.584143:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577d62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.584196:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788851186.584755:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.584762:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879577d69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.584771:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.584774:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.589498:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879577d69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.589536:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879577d69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.589625:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879577d69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.589634:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879577d69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.592670:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788851186.592684:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577d62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.592699:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ee00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851186.592704:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577d62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.592716:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577d62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.592738:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577d62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.592746:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577d62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.593295:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851186.593304:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879577d69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.593313:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f000 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851186.593317:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879577d69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.593337:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879577d69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.593350:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879577d69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.593358:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.593360:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.593362:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.593634:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788851186.593643:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fced8b82/0x7ad3e1a879577d69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.595375:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.598830:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.598848:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577d70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.598942:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.598947:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.598954:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577d70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.598970:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577d70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.599058:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577d70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.599083:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577d70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.599118:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851186.601842:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851186.601870:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577d70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.601884:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f800 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851186.601889:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577d70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.601900:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577d70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.601924:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577d70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.601932:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577d70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.601973:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.601975:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.601977:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.603930:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.603943:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.603958:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.603962:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.603968:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.607078:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.607093:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.607112:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.607139:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851186.607458:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851186.607466:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.607474:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851186.607479:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.607488:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.607505:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d77 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.607512:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577d77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.607534:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.607536:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.607537:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.608434:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.608444:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.608465:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.608470:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.608475:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.608486:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.608495:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.608502:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.608528:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851186.608930:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851186.608938:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.608957:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851186.608961:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.608970:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.608986:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.608994:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577d7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.609012:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.609014:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.609015:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.611163:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.611182:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.611200:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.611206:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.611212:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.611227:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.611251:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.611259:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.611281:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788851186.614343:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.614359:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.614377:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.614381:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.614388:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.614394:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851186.614402:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.614403:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.614411:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5400 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851186.614414:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.614415:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.614424:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.614427:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.614456:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.614462:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851186.614464:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577d85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.614488:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851186.614491:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.614497:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5800 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851186.614501:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.614508:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.614518:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d8c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.614524:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.614537:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.614538:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.614545:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851186.615583:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788851186.628308:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788851186.631181:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.631198:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.631221:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.631233:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.631241:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.631367:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.631383:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.631391:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.631419:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851186.631919:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851186.631927:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.631936:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4e00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851186.631941:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.631950:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.631971:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.631979:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075c04946/0x7ad3e1a879577d93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.632001:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851186.632002:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851186.632004:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.633321:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.633336:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.633933:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.633950:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.633962:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.633977:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.633987:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.633994:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.634014:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851186.635674:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851186.635685:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.635697:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5800 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851186.635702:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.635713:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.635735:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d9a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.635743:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ffa25ce/0x7ad3e1a879577d9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851186.635766:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.635768:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.635770:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.639385:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.639400:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577da1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.639421:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.639426:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.639432:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577da1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.639448:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577da1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.639459:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577da1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.639476:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577da1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.639544:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788851186.643904:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.643917:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577da8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.643934:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.643939:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.643944:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577da8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.643959:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577da8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.643969:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577da8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.643978:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577da8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.648460:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788851186.648475:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577da1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.648491:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5400 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851186.648496:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577da1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.648517:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577da1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.648542:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577da1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.648561:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000618d427a/0x7ad3e1a879577da1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.648587:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851186.648591:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577da8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.648598:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851186.648600:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577da8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.648607:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577da8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.648615:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577da8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.648622:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851186.648624:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851186.648632:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851186.650114:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.650494:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788851186.650506:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002686caa6/0x7ad3e1a879577da8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851186.651817:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.651827:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577daf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.651845:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.651850:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.651856:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577daf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.651870:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577daf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.651880:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577daf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.651887:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577daf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.651905:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851186.652359:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851186.652367:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577daf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.652375:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851186.652380:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577daf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.652389:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577daf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.652408:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577daf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.652416:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059a63cef/0x7ad3e1a879577daf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.652450:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851186.652452:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851186.652453:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.652766:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.652773:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577db6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.652812:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.652817:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.652829:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577db6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.652840:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577db6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.652849:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577db6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.652856:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577db6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.652877:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851186.655452:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851186.655471:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577db6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.655488:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a5a00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851186.655493:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577db6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.655518:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577db6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.655540:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577db6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.655548:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000902dedb5/0x7ad3e1a879577db6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.655575:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851186.655578:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851186.655580:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788851186.656113:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.656124:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577dbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.656140:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.656144:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.656150:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577dbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.657360:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577dbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.657375:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577dbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.657401:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577dbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.657492:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788851186.661047:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788851186.661060:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577dc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.661077:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=519s v=(0 0) 00010000:00010000:3.0:1788851186.661081:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851186.661087:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577dc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.661113:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577dc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.661122:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577dc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851186.661130:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577dc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.664907:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788851186.664923:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577dbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.664937:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f800 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851186.664943:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577dbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.664954:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577dbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.664978:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577dbd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.665000:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2df5e23/0x7ad3e1a879577dbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.665027:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851186.665030:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577dc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.665037:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ee00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851186.665040:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577dc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.665047:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577dc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.665058:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577dc4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851186.665065:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851186.665067:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851186.665069:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851186.673354:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788851186.673370:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047a832ad/0x7ad3e1a879577dc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851186.673715:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788851186.677240:0:15073:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1788851186.677692:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf040380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14411:x1875746019704704:12345-0@lo:5:osp-pre-0-0.0 Request processed in 158598us (158997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851186.677705:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788851186.678427:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14411:1875746019704704:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788851186.678448:0:14411:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788851186.678501:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14411:1875746019704832:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788851186.678555:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851186.678620:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788851186.681379:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704832 00000100:00100000:2.0:1788851186.681399:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704832 00000100:00100000:2.0:1788851186.681480:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788851186.681492:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14411:x1875746019704832:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788851186.681560:0:15072:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1788851186.695656:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf043b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14411:x1875746019704832:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14157us (17102us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788851186.695672:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788851186.696425:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14411:1875746019704832:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788851186.696458:0:14411:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1788851187.221243:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851187.541632:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788851172/real 1788851172] req@ffff8a9b8bcf3100 x1875746019699840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851187 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851187.541665:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8a9b8bcf3100 x1875746019699840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788851187 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788851187.541684:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c33800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851187.541704:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788851187.541707:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019699840:0@lo:8:kworker.0 00000100:00080000:2.0:1788851187.541819:0:12292:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851187.541823:0:12292:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788851187.541826:0:12292:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c33800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851187.541830:0:12292:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 505 00000100:00080000:2.0:1788851187.541835:0:12292:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788851187.541845:0:12292:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a9b87c33800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1788851187.541864:0:12292:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9bb4168380 x1875746019705216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788851187.541904:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4169f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019705472:0@lo:400:kworker.0 00000100:00100000:2.0:1788851187.541962:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851187.542010:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788851187.542024:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4168000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3308:1875746019704960:0@lo:400:kworker.0 00000100:00100000:2.0:1788851187.542052:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851187.542092:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019705088:0@lo:400:kworker.0 00000100:00100000:2.0:1788851187.542118:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851187.542137:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851187.542142:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019705344:0@lo:400:kworker.0 00000100:00100000:2.0:1788851187.542163:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851187.542197:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705472 00000100:00100000:2.0:1788851187.542205:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705472 00000100:00100000:2.0:1788851187.542248:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705344 00000100:00100000:2.0:1788851187.542252:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705344 00000100:00100000:2.0:1788851187.542270:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788851187.542279:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019705472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851187.542329:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4168e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019705472:12345-0@lo:400:kworker.0 Request processed in 50us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851187.542336:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788851187.542352:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788851187.542357:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019705344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851187.542387:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019705344:12345-0@lo:400:kworker.0 Request processed in 29us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851187.542392:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788851187.542409:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019704960 00000100:00100000:2.0:1788851187.542412:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019704960 00000100:00100000:2.0:1788851187.542435:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788851187.542441:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:3308:x1875746019704960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851187.542467:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:3308:x1875746019704960:12345-0@lo:400:kworker.0 Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851187.542482:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788851187.542509:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705088 00000100:00100000:2.0:1788851187.542513:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705088 00000100:00100000:2.0:1788851187.542614:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788851187.542622:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875746019705088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851187.542652:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875746019705088:12345-0@lo:400:kworker.0 Request processed in 32us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851187.542657:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788851187.542697:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb416a300 x1875746019705344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788851187.542710:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019705344:0@lo:400:kworker.0 00000100:00100000:2.0:1788851187.542721:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019705088:0@lo:400:kworker.0 00000100:00100000:2.0:1788851187.542740:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019705216:0@lo:8:kworker.0 00000100:00100000:2.0:1788851187.542767:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851187.542822:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705216 00000100:00100000:2.0:1788851187.542826:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705216 00000100:00100000:2.0:1788851187.542845:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788851187.542850:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875746019705216:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788851187.542869:0:15072:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788851187.548254:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4168000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3308:1875746019704960:0@lo:400:kworker.0 00010000:00080000:3.0:1788851187.548277:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb4169f80 x1875746019705472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851187.548289:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4169f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019705472:0@lo:400:kworker.0 00000100:00100000:2.0:1788851187.579654:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875746019705216:12345-0@lo:8:kworker.0 Request processed in 36794us (36876us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851187.579670:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788851187.579730:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c33800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851187.579736:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851187.579756:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019705216:0@lo:8:kworker.0 00000001:00100000:1.0:1788851187.878901:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788851187.878927:0:6732:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:1.0:1788851188.249820:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851189.267073:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851190.293284:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851191.321675:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851191.827564:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851191.827590:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019705600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851191.827658:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851191.827858:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705600 00000100:00100000:0.0:1788851191.827866:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705600 00000100:00100000:0.0:1788851191.827918:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851191.827927:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019705600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788851191.827963:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788851191.828020:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019705600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851191.828027:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788851191.828066:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788851191.828086:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf043800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019705600:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788851191.828282:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788851192.339368:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788851192.849899:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788851192.849906:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788851192.849909:0:37:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c33800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788851192.849917:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:2.0:1788851192.849923:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788851192.849934:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a9b87c33800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:2.0:1788851192.849958:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9bb416aa00 x1875746019705984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788851192.850043:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3310:1875746019705728:0@lo:400:kworker.0 00000100:00100000:2.0:1788851192.850125:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851192.850190:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851192.850196:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019705856:0@lo:400:kworker.0 00000100:00100000:2.0:1788851192.850226:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851192.850260:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019705984:0@lo:8:kworker.0 00000100:00100000:2.0:1788851192.850283:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851192.850310:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb4168a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019706112:0@lo:400:kworker.0 00000100:00100000:2.0:1788851192.850337:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851192.850355:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788851192.850360:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019706240:0@lo:400:kworker.0 00000100:00100000:2.0:1788851192.850380:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851192.850413:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705856 00000100:00100000:2.0:1788851192.850422:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705856 00000100:00100000:2.0:1788851192.850462:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705984 00000100:00100000:2.0:1788851192.850466:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705984 00000100:00100000:2.0:1788851192.850481:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788851192.850501:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019705856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851192.850555:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019705856:12345-0@lo:400:kworker.0 Request processed in 55us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851192.850562:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788851192.850578:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788851192.850582:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875746019705984:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788851192.850598:0:15074:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788851192.851217:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019706112 00000100:00100000:0.0:1788851192.851223:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019706112 00000100:00100000:0.0:1788851192.851251:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019706240 00000100:00100000:0.0:1788851192.851255:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019706240 00000100:00100000:0.0:1788851192.851283:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788851192.851289:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019706112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851192.851339:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4169500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019706112:12345-0@lo:400:kworker.0 Request processed in 50us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851192.851346:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788851192.851360:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788851192.851367:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019706240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851192.851393:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4169f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019706240:12345-0@lo:400:kworker.0 Request processed in 27us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851192.851398:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788851192.852145:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019705728 00000100:00100000:3.0:1788851192.852154:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019705728 00000100:00100000:3.0:1788851192.852191:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788851192.852199:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:3310:x1875746019705728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851192.852249:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:3310:x1875746019705728:12345-0@lo:400:kworker.0 Request processed in 52us (2126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851192.852255:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1788851192.852290:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788851192.852359:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb416ad80 x1875746019706240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851192.852374:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019706240:0@lo:400:kworker.0 00010000:00080000:3.0:1788851192.852387:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb4168a80 x1875746019706112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788851192.852395:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4168a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019706112:0@lo:400:kworker.0 00000100:00100000:3.0:1788851192.852444:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019705856:0@lo:400:kworker.0 00000100:00100000:3.0:1788851192.852454:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb4168380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3310:1875746019705728:0@lo:400:kworker.0 00000100:00100000:2.0:1788851192.877331:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4168700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1875746019705984:12345-0@lo:8:kworker.0 Request processed in 26739us (27039us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788851192.877346:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788851192.877403:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c33800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788851192.877409:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788851192.877413:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019705984:0@lo:8:kworker.0 00010000:00010000:0.0:1788851193.362092:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788851193.815490:0:15787:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788851193.815493:0:15787:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788851193.815634:0:15787:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8a9bb45fa000 00000020:01000004:2.0:1788851193.815652:0:15787:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788851193.815667:0:15787:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788851193.815679:0:15787:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8a9bc1e13380) 00000020:00000080:2.0:1788851193.815697:0:15787:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788851193.830402:0:15787:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788851193.831777:0:15787:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788851193.834404:0:15787:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788851193.834885:0:15787:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788851193.835205:0:15787:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788851193.835852:0:15787:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 673: rc = 0 00100000:10000000:1.0:1788851193.836200:0:15787:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 673: rc = 0 00100000:10000000:1.0:1788851193.836378:0:15787:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 673: rc = 0 00100000:10000000:1.0:1788851193.837218:0:15787:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 515: rc = 0 00100000:10000000:1.0:1788851193.837869:0:15787:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 515: rc = 0 00100000:10000000:1.0:1788851193.838633:0:15787:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 515: rc = 0 00100000:10000000:1.0:1788851193.839009:0:15787:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 515: rc = 0 00100000:10000000:1.0:1788851193.839414:0:15787:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 515: rc = 0 00100000:10000000:1.0:1788851193.839893:0:15787:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 515: rc = 0 00000020:00000080:1.0:1788851193.841357:0:15787:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788851193.841379:0:15787:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788851193.841390:0:15787:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7ad3e1a879577dd2 00000020:01000004:1.0:1788851193.841399:0:15787:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788851193.841420:0:15787:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.106@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788851193.841424:0:15787:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.106@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788851193.841430:0:15787:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788851193.841451:0:15787:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788851193.841456:0:15787:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.106@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788851193.854558:0:15787:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.106@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788851193.854620:0:15787:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.106@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788851193.854624:0:15787:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788851193.854626:0:15787:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788851193.854628:0:15787:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851193.854629:0:15787:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851193.854630:0:15787:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851193.854631:0:15787:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851193.854633:0:15787:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788851193.854635:0:15787:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851193.854636:0:15787:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788851193.854641:0:15787:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788851193.854643:0:15787:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788851193.854644:0:15787:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788851193.854645:0:15787:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851193.854647:0:15787:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851193.854648:0:15787:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851193.854683:0:15787:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851193.854684:0:15787:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788851193.854685:0:15787:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851193.854687:0:15787:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788851193.854810:0:15787:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788851193.854832:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019706368:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788851193.854906:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851193.855050:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905fd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788851193.855248:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019706368 00000100:00100000:3.0:1788851193.855257:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019706368 00000100:00100000:3.0:1788851193.855315:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788851193.855327:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:15787:x1875746019706368:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788851193.855373:0:14380:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788851193.855377:0:14380:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788851193.855381:0:14380:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788851193.868384:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:15787:x1875746019706368:12345-0@lo:253:mount.lustre.0 Request processed in 13048us (13466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851193.868401:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788851193.868648:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019706368:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788851193.868665:0:15787:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788851193.868683:0:15787:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788851193.868684:0:15787:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788851193.868686:0:15787:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788851193.868687:0:15787:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788851193.868688:0:15787:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788851193.868689:0:15787:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788851193.868690:0:15787:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788851193.868692:0:15787:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788851193.868693:0:15787:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788851193.868712:0:15787:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8a9bb45fa000 from lustre-OST0001 10000000:01000000:1.0:1788851193.868744:0:15787:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788851193.868747:0:15787:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788851193.868754:0:15787:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8a9b98d10000 local copy 00010000:00010000:1.0:1788851193.868766:0:15787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547000/0x7ad3e1a879577b78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577b7f expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851193.869053:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019706496:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851193.870868:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851193.870930:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905fd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788851193.871020:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019706496 00000100:00100000:3.0:1788851193.871031:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019706496 00000100:00100000:3.0:1788851193.871112:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788851193.871123:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:15787:x1875746019706496:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851193.871496:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:15787:x1875746019706496:12345-0@lo:501:mount.lustre.0 Request processed in 375us (634us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788851193.871505:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788851193.872153:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019706496:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788851193.872181:0:15787:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.106@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788851193.872371:0:15787:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.106@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788851193.872380:0:15787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90547000/0x7ad3e1a879577b78 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577b7f expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851193.872392:0:15787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b90547000/0x7ad3e1a879577b78 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577b7f expref: -99 pid: 14370 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851193.872431:0:15787:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8a9bb45fa000 10000000:01000000:2.0:1788851193.872436:0:15787:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788851193.872443:0:15787:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788851193.872446:0:15787:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788851193.872451:0:15787:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788851193.872454:0:15787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788851193.872489:0:15787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90546000/0x7ad3e1a879577dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851193.872497:0:15787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b90546000/0x7ad3e1a879577dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851193.872507:0:15787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b90546000/0x7ad3e1a879577dd9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851193.872529:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019706624:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788851193.872850:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851193.872892:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788851193.873435:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019706624 00000100:00100000:0.0:1788851193.873445:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019706624 00000100:00100000:0.0:1788851193.873502:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788851193.873512:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:15787:x1875746019706624:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788851193.873524:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851193.874507:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af7c00/0x7ad3e1a879577de0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577dd9 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851193.874612:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af7c00/0x7ad3e1a879577de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577dd9 expref: 17 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851193.874625:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af7c00/0x7ad3e1a879577de0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577dd9 expref: 17 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851193.874635:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7c00, rc 0) 00000100:00100000:0.0:1788851193.874720:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:15787:x1875746019706624:12345-0@lo:101:mount.lustre.0 Request processed in 1209us (1870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851193.874729:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788851193.874861:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019706624:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851193.874880:0:15787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b90546000/0x7ad3e1a879577dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577de0 expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851193.874890:0:15787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b90546000/0x7ad3e1a879577dd9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577de0 expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851193.877077:0:15787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788851193.878907:0:15787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788851193.879447:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788851193.879496:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788851193.879625:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788851193.879678:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788851193.879728:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788851193.879766:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788851193.880172:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788851193.880183:0:15787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788851193.880363:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019706752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851193.880451:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851193.880633:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851193.880683:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019706752 00000100:00100000:2.0:1788851193.880691:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019706752 00000100:00100000:2.0:1788851193.880758:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788851193.880776:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:15787:x1875746019706752:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851193.882284:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:15787:x1875746019706752:12345-0@lo:501:mount.lustre.0 Request processed in 1507us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851193.882295:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788851193.882994:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019706752:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851193.883062:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019706880:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851193.883352:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851193.883429:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788851193.883473:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019706880 00000100:00100000:0.0:1788851193.883481:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019706880 00000100:00100000:0.0:1788851193.883609:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788851193.883619:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:15787:x1875746019706880:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788851193.884484:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:15787:x1875746019706880:12345-0@lo:503:mount.lustre.0 Request processed in 861us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851193.884493:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788851193.884662:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019706880:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788851193.886409:0:15787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788851193.886517:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707008:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851193.886907:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851193.887044:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788851193.887368:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019707008 00000100:00100000:2.0:1788851193.887378:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019707008 00000100:00100000:2.0:1788851193.887483:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788851193.887493:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:15787:x1875746019707008:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851193.887771:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:15787:x1875746019707008:12345-0@lo:502:mount.lustre.0 Request processed in 278us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851193.887819:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788851193.887967:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707008:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851193.888312:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788851193.888368:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788851193.888402:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788851193.888450:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788851193.888491:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788851193.888526:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788851193.888575:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788851193.888610:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788851193.888672:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788851193.888714:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707136:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851193.888768:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851193.889601:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8bd3bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788851193.889702:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019707136 00000100:00100000:1.0:1788851193.889719:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019707136 00000100:00100000:2.0:1788851193.889808:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788851193.889823:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:15787:x1875746019707136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851193.890082:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:15787:x1875746019707136:12345-0@lo:502:mount.lustre.0 Request processed in 262us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851193.890090:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788851193.890193:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788851193.890522:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788851193.890566:0:15787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788851193.892625:0:15788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788851193.892639:0:15788:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788851193.892647:0:15788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851193.892649:0:15788:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788851193.892657:0:15788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788851193.892691:0:15788:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8a9a81eecd40) 00000020:00000080:3.0:1788851193.892863:0:15788:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788851193.892872:0:15788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788851193.892945:0:15788:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a9bb45fa000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788851193.892965:0:15788:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788851193.892974:0:15788:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7ad3e1a879577dee 00010000:00010000:3.0:1788851193.899200:0:15788:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1788851193.899936:0:15788:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788851193.904899:0:15788:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788851193.907499:0:15788:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788851193.907512:0:15788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851193.907518:0:15788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851193.907520:0:15788:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788851193.907523:0:15788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851193.907528:0:15788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851193.907542:0:15788:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788851193.907546:0:15788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788851193.907547:0:15788:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788851193.907549:0:15788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851193.907551:0:15788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851193.907552:0:15788:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788851193.907555:0:15788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788851193.907557:0:15788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851193.907558:0:15788:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788851193.907561:0:15788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788851193.907620:0:15788:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788851193.907624:0:15788:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788851193.907634:0:15788:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788851193.907638:0:15788:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788851193.908138:0:15787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788851193.908168:0:15787:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788851193.908192:0:15787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90546000/0x7ad3e1a879577dd9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577de0 expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851193.908206:0:15787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b90546000/0x7ad3e1a879577dd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577de0 expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851193.908215:0:15787:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9bb45fa000 from 1 10000000:01000000:1.0:1788851193.908217:0:15787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788851193.908503:0:15787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9baef58200/0x7ad3e1a879577df5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851193.908524:0:15787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9baef58200/0x7ad3e1a879577df5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851193.908607:0:15787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9baef58200/0x7ad3e1a879577df5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851193.908633:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788851193.908822:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851193.908877:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905fd240 going to sleep for 11 seconds 00000100:00100000:2.0:1788851193.908980:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019707264 00000100:00100000:2.0:1788851193.908990:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019707264 00000100:00100000:2.0:1788851193.909047:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788851193.909056:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:15787:x1875746019707264:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851193.909070:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851193.909085:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b90546a00/0x7ad3e1a879577dfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577df5 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851193.909120:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90546a00/0x7ad3e1a879577dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577df5 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851193.909146:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b90546a00/0x7ad3e1a879577dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577df5 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851193.909156:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546a00, rc 0) 00000100:00100000:2.0:1788851193.909200:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:15787:x1875746019707264:12345-0@lo:101:mount.lustre.0 Request processed in 145us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851193.909207:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788851193.909483:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851193.909499:0:15787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9baef58200/0x7ad3e1a879577df5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577dfc expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851193.909509:0:15787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9baef58200/0x7ad3e1a879577df5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577dfc expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851193.910896:0:15787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788851193.912917:0:15787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788851193.913667:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788851193.914335:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788851193.914442:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788851193.914452:0:15787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788851193.915152:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788851193.916150:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851193.916316:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b905fd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788851193.916374:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019707392 00000100:00100000:3.0:1788851193.916384:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019707392 00000100:00100000:3.0:1788851193.917340:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788851193.917354:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:15787:x1875746019707392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851193.917776:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:15787:x1875746019707392:12345-0@lo:501:mount.lustre.0 Request processed in 425us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851193.917803:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788851193.917913:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707392:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788851193.917983:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707520:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788851193.918094:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851193.918131:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9ba00efcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851193.918222:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019707520 00000100:00100000:3.0:1788851193.918228:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019707520 00000100:00100000:3.0:1788851193.918263:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788851193.918270:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:15787:x1875746019707520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788851193.918829:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:15787:x1875746019707520:12345-0@lo:503:mount.lustre.0 Request processed in 558us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851193.918837:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788851193.918921:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707520:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788851193.919761:0:15787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788851193.919970:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707648:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851193.920109:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851193.920257:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9ba00efcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851193.920304:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019707648 00000100:00100000:3.0:1788851193.920312:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019707648 00000100:00100000:3.0:1788851193.920391:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788851193.920400:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:15787:x1875746019707648:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851193.920636:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:15787:x1875746019707648:12345-0@lo:502:mount.lustre.0 Request processed in 236us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851193.920644:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788851193.920841:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707648:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788851193.921273:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788851193.921334:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788851193.921385:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788851193.921548:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788851193.921587:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788851193.921644:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788851193.921682:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788851193.921716:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788851193.921756:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788851193.921832:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851193.921873:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9ba00efcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851193.922331:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019707776 00000100:00100000:2.0:1788851193.922340:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019707776 00000100:00100000:2.0:1788851193.922390:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788851193.922399:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:15787:x1875746019707776:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851193.924227:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:15787:x1875746019707776:12345-0@lo:502:mount.lustre.0 Request processed in 1821us (2386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851193.924238:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788851193.924333:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707776:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788851193.924628:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788851193.924649:0:15787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788851193.925937:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851193.925948:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851193.925950:0:15792:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788851193.925969:0:15792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a9bb45fa000 00000020:00000080:1.0:1788851193.925971:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788851193.925978:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851193.925980:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851193.925981:0:15792:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788851193.925983:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851193.925985:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851193.925986:0:15792:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788851193.925989:0:15792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8a9bb45fa000 00000020:00000080:1.0:1788851193.925991:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788851193.926177:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851193.926181:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851193.926183:0:15792:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788851193.926186:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788851193.926188:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851193.926190:0:15792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788851193.926193:0:15792:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8a9bb45fa000 00000020:00000080:1.0:1788851193.926195:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788851193.926637:0:15792:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788851193.926641:0:15792:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788851193.926643:0:15792:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788851193.926647:0:15792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788851193.926968:0:15787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788851193.926993:0:15787:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788851193.927018:0:15787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9baef58200/0x7ad3e1a879577df5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577dfc expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851193.927126:0:15787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9baef58200/0x7ad3e1a879577df5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577dfc expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851193.927250:0:15787:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788851193.927253:0:15787:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8a9bb45fa000 10000000:01000000:2.0:1788851193.927256:0:15787:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8a9bb45fa000 10000000:01000000:2.0:1788851193.927260:0:15787:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788851193.927266:0:15787:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8a9bb45fa000 from 1 10000000:01000000:2.0:1788851193.927274:0:15787:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788851193.927309:0:15787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90546600/0x7ad3e1a879577e03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851193.927318:0:15787:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b90546600/0x7ad3e1a879577e03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851193.927328:0:15787:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b90546600/0x7ad3e1a879577e03 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851193.927353:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788851193.927433:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851193.927554:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019707904 00000100:00100000:1.0:1788851193.927561:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019707904 00000100:00100000:1.0:1788851193.927603:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788851193.927612:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:15787:x1875746019707904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788851193.927625:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851193.927636:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9baef58a00/0x7ad3e1a879577e0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577e03 expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851193.927665:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9baef58a00/0x7ad3e1a879577e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577e03 expref: 19 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851193.927675:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9baef58a00/0x7ad3e1a879577e0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577e03 expref: 19 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851193.927684:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58a00, rc 0) 00000100:00100000:1.0:1788851193.927721:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:15787:x1875746019707904:12345-0@lo:101:mount.lustre.0 Request processed in 110us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851193.927727:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788851193.927817:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851193.927839:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019707904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788851193.927852:0:15787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b90546600/0x7ad3e1a879577e03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577e0a expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851193.927862:0:15787:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b90546600/0x7ad3e1a879577e03 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577e0a expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788851193.928680:0:15787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788851193.929972:0:15787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788851193.930679:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788851193.930728:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788851193.930764:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788851193.930913:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788851193.930950:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788851193.931014:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788851193.931126:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788851193.931241:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788851193.931312:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788851193.931344:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788851193.931394:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788851193.931575:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788851193.931614:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788851193.931645:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788851193.931694:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788851193.931732:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788851193.931765:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788851193.931903:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788851193.931939:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788851193.931985:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788851193.932105:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788851193.932219:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788851193.932259:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788851193.932309:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788851193.932348:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788851193.932383:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788851193.932586:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788851193.932628:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788851193.932662:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788851193.932708:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788851193.932740:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788851193.932769:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788851193.932896:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788851193.932976:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788851193.933017:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788851193.933216:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788851193.933257:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788851193.933354:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788851193.933362:0:15787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788851193.933615:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019708032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851193.933694:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851193.933815:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851193.937255:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019708032 00000100:00100000:3.0:1788851193.937269:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019708032 00000100:00100000:3.0:1788851193.937350:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788851193.937361:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:15787:x1875746019708032:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788851193.938383:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:15787:x1875746019708032:12345-0@lo:501:mount.lustre.0 Request processed in 1019us (4683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851193.938394:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788851193.938634:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019708032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788851193.938686:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019708160:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851193.938731:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851193.938765:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019708160 00000100:00100000:2.0:1788851193.938770:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019708160 00000100:00100000:2.0:1788851193.938824:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788851193.938831:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:15787:x1875746019708160:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788851193.939089:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:15787:x1875746019708160:12345-0@lo:503:mount.lustre.0 Request processed in 257us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851193.939096:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788851193.939220:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851193.939235:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019708160:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788851193.939890:0:15787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788851193.939967:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019708288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851193.940013:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851193.940032:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851193.940280:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019708288 00000100:00100000:3.0:1788851193.940286:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019708288 00000100:00100000:3.0:1788851193.940315:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788851193.940322:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:15787:x1875746019708288:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788851193.940847:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:15787:x1875746019708288:12345-0@lo:502:mount.lustre.0 Request processed in 523us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851193.940856:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788851193.944623:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019708288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788851193.946222:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788851193.946329:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788851193.946362:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788851193.946531:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788851193.946570:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788851193.946616:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788851193.946647:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788851193.946686:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788851193.946729:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788851193.946765:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788851193.946829:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788851193.946879:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788851193.946914:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788851193.946947:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788851193.947009:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788851193.948283:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788851193.948333:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788851193.948432:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788851193.948554:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788851193.948593:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788851193.948646:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788851193.948683:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788851193.948717:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788851193.948766:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788851193.948826:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788851193.948863:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788851193.948914:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788851193.948953:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788851193.949004:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788851193.950325:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788851193.950390:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788851193.950583:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788851193.950618:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788851193.950697:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788851193.950738:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788851193.950809:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788851193.950847:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788851193.950882:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788851193.950934:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788851193.950983:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788851193.952245:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019708416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851193.952332:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851193.952387:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019708416 00000100:00100000:2.0:1788851193.952395:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019708416 00000100:00100000:2.0:1788851193.952585:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788851193.952596:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc16adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:15787:x1875746019708416:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788851193.952869:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc16adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:15787:x1875746019708416:12345-0@lo:502:mount.lustre.0 Request processed in 275us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851193.952878:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788851193.952942:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851193.952981:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019708416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788851193.954137:0:15787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788851193.954231:0:15787:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788851193.956001:0:15797:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788851193.956019:0:15797:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8a9a81ee99c0) 00000020:00000080:3.0:1788851193.956261:0:15797:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788851193.956362:0:15797:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8a9bb45fa000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788851193.956366:0:15797:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8a9bb45fa000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788851193.956370:0:15797:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8a9bb45fa000 3 00010000:00080000:3.0:1788851193.956544:0:15797:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8a9bb44b4000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.106@tcp at head 00010000:00010000:0.0:1788851193.959432:0:15797:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788851193.962723:0:15797:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788851193.962775:0:15797:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788851193.962812:0:15797:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7ad3e1a879577e18 00000100:00080000:0.0:1788851193.962826:0:15797:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788851193.962841:0:15797:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8a9bb44b4000 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:0.0:1788851193.962886:0:15797:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9b8bcf2d80 x1875746019708544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788851193.962915:0:15797:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788851193.963226:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788851193.963231:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788851193.963234:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c33800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788851193.963238:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 525 00000100:00080000:3.0:1788851193.963241:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788851193.963247:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a9b87c33800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:3.0:1788851193.963261:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9bb45a5880 x1875746019708800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788851193.963309:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019708672:0@lo:400:kworker.0 00000100:00100000:3.0:1788851193.963376:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1788851193.963487:0:15797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1788851193.963565:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875746019708544:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788851193.963601:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851193.963626:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019708544 00000100:00100000:1.0:1788851193.963633:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019708800:0@lo:8:kworker.0 00000100:00100000:0.0:1788851193.963633:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019708544 00000100:00100000:1.0:1788851193.963655:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851193.963663:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851193.963670:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1875746019708544:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788851193.963699:0:14388:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 526 last 0 00000100:00100000:3.0:1788851193.963706:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788851193.963712:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019708928:0@lo:400:kworker.0 00000100:00100000:3.0:1788851193.963737:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851193.963766:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019709056:0@lo:400:kworker.0 00000020:00000080:0.0:1788851193.963812:0:14388:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7ad3e1a879577e1f 00000100:00100000:1.0:1788851193.963825:0:14389:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788851193.963837:0:14389:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000020:01000000:2.0:1788851193.963911:0:15787:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788851193.963945:0:15787:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788851193.963976:0:15787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b90546600/0x7ad3e1a879577e03 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577e0a expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851193.963987:0:15787:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b90546600/0x7ad3e1a879577e03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577e0a expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788851193.964175:0:15787:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788851193.964178:0:15787:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788851193.964179:0:15787:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851193.964180:0:15787:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851193.964182:0:15787:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851193.964183:0:15787:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851193.964184:0:15787:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788851193.964185:0:15787:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851193.964187:0:15787:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788851193.964195:0:15787:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788851193.964197:0:15787:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788851193.964199:0:15787:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788851193.964199:0:15787:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788851193.964200:0:15787:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788851193.964201:0:15787:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788851193.964202:0:15787:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788851193.964203:0:15787:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788851193.964204:0:15787:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788851193.964205:0:15787:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788851193.964223:0:15787:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788851193.964235:0:15787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019709184:0@lo:253:mount.lustre.0 00000004:00100000:0.0:1788851193.964455:0:14388:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788851193.964494:0:14388:0:(import.c:65:import_set_state_nolock()) ffff8a9bbcd7b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788851193.964567:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf043800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875746019708544:12345-0@lo:38:llog_process_th.0 Request processed in 895us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851193.964570:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851193.964575:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851193.964591:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019708928 00000100:00100000:0.0:1788851193.964595:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019708928 00000100:00100000:3.0:1788851193.964608:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019708672 00000100:00100000:3.0:1788851193.964611:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019708672 00000100:00100000:0.0:1788851193.964616:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709056 00000100:00100000:0.0:1788851193.964618:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709056 00000100:00100000:0.0:1788851193.964630:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788851193.964636:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019708928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851193.964643:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019708800 00000100:00100000:3.0:1788851193.964645:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019708800 00000100:00100000:3.0:1788851193.964655:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788851193.964662:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019708672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851193.964675:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019708928:12345-0@lo:400:kworker.0 Request processed in 39us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851193.964681:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788851193.964692:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019708672:12345-0@lo:400:kworker.0 Request processed in 31us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851193.964692:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788851193.964698:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788851193.964698:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019709056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851193.964708:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851193.964713:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf040a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875746019708800:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788851193.964741:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019709056:12345-0@lo:400:kworker.0 Request processed in 43us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851193.964743:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf040a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1875746019708800:12345-0@lo:8:kworker.0 Request processed in 29us (1087us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788851193.964748:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788851193.964752:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788851193.964771:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788851193.964877:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb45a7800 x1875746019708928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788851193.964880:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9b8bcf2d80 x1875746019708544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788851203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851193.964889:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:0.0:1788851193.964892:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019708928:0@lo:400:kworker.0 00000100:00080000:1.0:1788851193.964895:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00100000:0.0:1788851193.964902:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019708672:0@lo:400:kworker.0 00000100:00080000:1.0:1788851193.964904:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788851193.964908:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788851193.964910:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9bb44b4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788851193.964915:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1875746019708544:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788851193.964924:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00010000:00080000:0.0:1788851193.964931:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8a9bb45a6300 x1875746019709056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788851193.964933:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c33800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788851193.964936:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788851193.964940:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019708800:0@lo:8:kworker.0 00000100:00100000:0.0:1788851193.964940:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019709056:0@lo:400:kworker.0 00000100:00100000:2.0:1788851193.965119:0:15787:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851193.965240:0:15787:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b956fbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788851193.968582:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709184 00000100:00100000:3.0:1788851193.968599:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709184 00000100:00100000:3.0:1788851193.968672:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788851193.968683:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:15787:x1875746019709184:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788851193.968720:0:14382:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788851193.968736:0:14382:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788851194.003612:0:14382:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788851194.003669:0:14382:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788851194.003905:0:14404:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788851194.003910:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788851194.003935:0:14404:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577e26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.003968:0:14404:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577cf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577cf2 expref: 19 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.003978:0:14404:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577e26 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.004021:0:14404:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879577cf2 expref: 19 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.004209:0:14404:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879577cf2 expref: 19 pid: 14380 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851194.004226:0:14404:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14404:1875746019709312:0@lo:104: 00000100:00100000:0.0:1788851194.004355:0:14404:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851194.004413:0:14404:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b9864d180 going to sleep for 11 seconds 00000100:00100000:3.0:1788851194.004580:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709312 00000100:00100000:3.0:1788851194.004589:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709312 00000100:00100000:3.0:1788851194.004648:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788851194.004658:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+3:14404:x1875746019709312:12345-0@lo:104: 00010000:00010000:3.0:1788851194.004672:0:14371:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b90547400/0x7ad3e1a879577cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879577cf9 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.004738:0:14371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788851194.004744:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+3:14404:x1875746019709312:12345-0@lo:104: Request processed in 88us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851194.004752:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788851194.004776:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851194.004817:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b90547400/0x7ad3e1a879577cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879577cf9 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.004825:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547400 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:3.0:1788851194.004829:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b90547400/0x7ad3e1a879577cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879577cf9 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.004838:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b90547400/0x7ad3e1a879577cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879577cf9 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851194.004845:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b90547400/0x7ad3e1a879577cf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879577cf9 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851194.004851:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788851194.004884:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b90547400/0x7ad3e1a879577cf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577cf9 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.004890:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851194.004911:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b90547400/0x7ad3e1a879577cf2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577cf9 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.004918:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b90547400/0x7ad3e1a879577cf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577cf9 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.004936:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851194.004938:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851194.004939:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851194.004972:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3309:1875746019709440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851194.005004:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851194.005157:0:14404:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14404:1875746019709312:0@lo:104: 00010000:00010000:1.0:1788851194.005181:0:14404:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577e26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851194.005301:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709440 00000100:00100000:3.0:1788851194.005312:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709440 00010000:00010000:3.0:1788851194.005333:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879577cf2 expref: 20 pid: 14380 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851194.005414:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788851194.005421:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+20:3309:x1875746019709440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851194.005432:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851194.005438:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577cf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879577cf2 expref: 20 pid: 14380 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.005448:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879577cf2 expref: 20 pid: 14380 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.005471:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577cf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879577cf2 expref: 20 pid: 14380 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.005484:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577e26 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.005492:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577e26 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788851194.005504:0:14375:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001847399s 00010000:00010000:3.0:1788851194.005509:0:14375:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577e26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.005515:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577e26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.005521:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577e26 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.005538:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577e26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.005544:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ee00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851194.005548:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577e26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.005556:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577e26 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.005571:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577e26 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.005581:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788851194.005615:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:3309:x1875746019709440:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851194.005622:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788851194.009836:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3309:1875746019709440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788851194.009882:0:14404:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577e26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.009894:0:14404:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577e26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851194.009902:0:14404:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577e26 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851194.013373:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4499850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:15787:x1875746019709184:12345-0@lo:253:mount.lustre.0 Request processed in 44683us (48244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851194.013389:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788851194.013592:0:15787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:88a8a83d-2380-4e6d-b8f7-1327e5aed605:15787:1875746019709184:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788851194.013627:0:15787:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788851194.013630:0:15787:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788851194.013632:0:15787:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788851194.013633:0:15787:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788851194.013635:0:15787:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788851194.013636:0:15787:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788851194.013637:0:15787:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788851194.013638:0:15787:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788851194.013640:0:15787:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788851194.013642:0:15787:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788851194.013656:0:15787:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788851194.022621:0:15787:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788851194.022880:0:15787:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788851194.023134:0:15787:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788851194.023442:0:15787:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788851194.023726:0:15787:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788851194.024305:0:15787:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788851194.025583:0:15787:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788851194.084990:0:15787:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788851194.084998:0:15787:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788851194.085104:0:15787:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788851194.085235:0:15787:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.106@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788851194.085251:0:15787:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788851194.085280:0:15787:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788851194.396368:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788851194.843128:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788851195.414268:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788851195.668809:0:14385:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788851195.668818:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8a9b929b7800 from 8 10000000:01000000:1.0:1788851195.668823:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788851195.668870:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9baef58000/0x7ad3e1a879577e2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851195.668883:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9baef58000/0x7ad3e1a879577e2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851195.668895:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9baef58000/0x7ad3e1a879577e2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851195.668934:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019709568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788851195.669007:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851195.669061:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98ccc180 going to sleep for 11 seconds 00000100:00100000:0.0:1788851195.669811:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709568 00000100:00100000:0.0:1788851195.669821:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709568 00000100:00100000:0.0:1788851195.669881:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788851195.669891:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:14385:x1875746019709568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788851195.669905:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851195.669946:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af6e00/0x7ad3e1a879577e34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577e2d expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851195.669974:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af6e00/0x7ad3e1a879577e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577e2d expref: 19 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851195.669987:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af6e00/0x7ad3e1a879577e34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577e2d expref: 19 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851195.669996:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6e00, rc 0) 00000100:00100000:0.0:1788851195.670069:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:14385:x1875746019709568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851195.670077:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788851195.670182:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019709568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851195.670199:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9baef58000/0x7ad3e1a879577e2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577e34 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851195.670215:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9baef58000/0x7ad3e1a879577e2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577e34 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851195.670270:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019709696:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788851195.670308:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851195.670339:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98ccc180 going to sleep for 11 seconds 00000100:00100000:0.0:1788851195.670400:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709696 00000100:00100000:0.0:1788851195.670405:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709696 00000100:00100000:0.0:1788851195.670436:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788851195.670443:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:14385:x1875746019709696:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788851195.670457:0:14382:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788851195.670474:0:14382:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788851195.670477:0:14382:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788851195.670562:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4499050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:14385:x1875746019709696:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851195.670569:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788851195.672893:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019709696:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788851195.673336:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788851195.673348:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9baef58000/0x7ad3e1a879577e2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577e34 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851195.673360:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9baef58000/0x7ad3e1a879577e2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577e34 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851196.438062:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851196.960587:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788851196.960618:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019709824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851196.960712:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851196.960812:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709824 00000100:00100000:3.0:1788851196.960821:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709824 00000100:00100000:3.0:1788851196.960882:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788851196.960891:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019709824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851196.960943:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851196.960996:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019709824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851196.961018:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788851196.961040:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851196.961194:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019709824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788851197.458757:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851198.482027:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851198.998489:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3311:1875746019709952:0@lo:400:kworker.0 00000100:00100000:3.0:1788851198.998571:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851198.998688:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019709952 00000100:00100000:0.0:1788851198.998698:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019709952 00000100:00100000:0.0:1788851198.998756:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788851198.998766:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:3311:x1875746019709952:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788851198.998920:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788851198.998924:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788851198.998927:0:8:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c33800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788851198.998938:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8a9b87c33800 using connection 192.168.204.106@tcp/0@lo 00000100:00100000:1.0:1788851198.998971:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8a9baf041180 x1875746019710208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788851199.001361:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4498c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:3311:x1875746019709952:12345-0@lo:400:kworker.0 Request processed in 2586us (2780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851199.001376:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788851199.004188:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019710080:0@lo:400:kworker.0 00000100:00100000:0.0:1788851199.004278:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851199.004360:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788851199.004368:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019710336:0@lo:400:kworker.0 00000100:00100000:0.0:1788851199.004396:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851199.004634:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019710464:0@lo:400:kworker.0 00000100:00100000:0.0:1788851199.004664:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851199.004699:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710336 00000100:00100000:0.0:1788851199.004708:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710336 00000100:00100000:0.0:1788851199.004763:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710464 00000100:00100000:0.0:1788851199.004767:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710464 00000100:00100000:0.0:1788851199.004826:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788851199.004837:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019710336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851199.004909:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019710336:12345-0@lo:400:kworker.0 Request processed in 73us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851199.004916:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788851199.004935:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788851199.004941:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019710464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851199.004986:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019710464:12345-0@lo:400:kworker.0 Request processed in 45us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851199.004992:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788851199.005416:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf043480 x1875746019710464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851199.005521:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf043480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019710464:0@lo:400:kworker.0 00010000:00080000:0.0:1788851199.005556:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf041c00 x1875746019710336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851199.005565:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf041c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019710336:0@lo:400:kworker.0 00000100:00100000:0.0:1788851199.005602:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019710208:0@lo:8:kworker.0 00000100:00100000:0.0:1788851199.005635:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851199.007114:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788851199.007137:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019710592:0@lo:400:kworker.0 00000100:00100000:0.0:1788851199.007195:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851199.007554:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710592 00000100:00100000:1.0:1788851199.007564:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710592 00000100:00100000:1.0:1788851199.007628:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788851199.007637:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019710592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851199.007694:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019710592:12345-0@lo:400:kworker.0 Request processed in 58us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851199.007701:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788851199.007740:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf043100 x1875746019710592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851215 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851199.007753:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019710592:0@lo:400:kworker.0 00000100:00100000:3.0:1788851199.008916:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3311:1875746019709952:0@lo:400:kworker.0 00000100:00100000:3.0:1788851199.009392:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710080 00000100:00100000:3.0:1788851199.009400:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710080 00000100:00100000:3.0:1788851199.009573:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710208 00000100:00100000:3.0:1788851199.009577:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710208 00000100:00100000:0.0:1788851199.012211:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788851199.014149:0:15072:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788851199.014169:0:15072:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:3.0:1788851199.014218:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788851199.014225:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851199.014234:0:15073:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788851199.014251:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851199.014261:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1875746019710208:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788851199.014307:0:15073:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:3.0:1788851199.014348:0:15073:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7ad3e1a879577e3b 00002000:00100000:3.0:1788851199.014365:0:15073:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8a9bb44b6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788851199.014369:0:15073:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788851199.014372:0:15073:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788851199.014908:0:15073:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788851199.014939:0:15073:0:(import.c:65:import_set_state_nolock()) ffff8a9bb44b1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788851199.015536:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875746019710208:12345-0@lo:8:kworker.0 Request processed in 1272us (9896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851199.015554:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788851199.016147:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf041180 x1875746019710208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788851224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788851199.016165:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788851199.016176:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788851199.016181:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788851199.016184:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8a9b87c33800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788851199.016212:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788851199.016218:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1875746019710208:0@lo:8:kworker.0 00000004:00080000:2.0:1788851199.016576:0:14412:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788851199.017113:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019710720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851199.017182:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851199.017237:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710720 00000100:00100000:0.0:1788851199.017244:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710720 00000004:00080000:3.0:1788851199.017389:0:14413:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788851199.017414:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14413:1875746019710848:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788851199.017496:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788851199.017509:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875746019710720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788851199.017556:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788851199.017608:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875746019710720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851199.017616:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788851199.017638:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788851199.017662:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9bb45a7100 x1875746019710720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788851215 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851199.017684:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019710720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851199.018284:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851199.018400:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb401b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788851199.019121:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710848 00000100:00100000:0.0:1788851199.019132:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710848 00000100:00100000:0.0:1788851199.019181:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788851199.019191:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14413:x1875746019710848:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788851199.019544:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019710080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851199.019624:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019710080:12345-0@lo:400:kworker.0 Request processed in 7400us (15345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851199.019631:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00080000:2.0:1788851199.019840:0:14412:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 531961057566ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788851199.021188:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019710080:0@lo:400:kworker.0 00002000:00080000:2.0:1788851199.035655:0:15073:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788851199.035668:0:15073:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788851199.035674:0:15073:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:2.0:1788851199.064498:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788851199.064512:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b1fe06/0x7ad3e1a879577e42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.064530:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1788851199.064536:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851199.064550:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000005b1fe06/0x7ad3e1a879577e42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.064569:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000005b1fe06/0x7ad3e1a879577e42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.064579:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000005b1fe06/0x7ad3e1a879577e42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.064585:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000005b1fe06/0x7ad3e1a879577e42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.064617:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788851199.065188:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788851199.065195:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577e49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.065206:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=532s v=(0 0) 00010000:00010000:2.0:1788851199.065209:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851199.065214:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577e49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.065222:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577e49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.065231:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577e49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.065250:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577e49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.065266:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788851199.065278:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788851199.065285:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000005b1fe06/0x7ad3e1a879577e42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.065292:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547200 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851199.066110:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851199.076575:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b1fe06/0x7ad3e1a879577e42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.076597:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000005b1fe06/0x7ad3e1a879577e42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.076623:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000005b1fe06/0x7ad3e1a879577e42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.076631:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000005b1fe06/0x7ad3e1a879577e42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.076678:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851199.076680:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851199.076683:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851199.076775:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851199.076816:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577e49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.076826:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547400 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851199.076829:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577e49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.076838:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577e49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.076850:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577e49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.076868:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff776b8b/0x7ad3e1a879577e49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.076884:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851199.076886:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851199.076887:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851199.076908:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851199.076910:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788851199.077643:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.077653:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeb26f26/0x7ad3e1a879577e50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.077666:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.077671:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.077677:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb26f26/0x7ad3e1a879577e50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.077692:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eeb26f26/0x7ad3e1a879577e50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.077701:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eeb26f26/0x7ad3e1a879577e50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.077720:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eeb26f26/0x7ad3e1a879577e50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.077736:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788851199.078172:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851199.078179:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eeb26f26/0x7ad3e1a879577e50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.078187:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7400 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851199.078191:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeb26f26/0x7ad3e1a879577e50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.078209:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eeb26f26/0x7ad3e1a879577e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.078225:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eeb26f26/0x7ad3e1a879577e50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.078233:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eeb26f26/0x7ad3e1a879577e50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.078250:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851199.078251:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851199.078253:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788851199.083285:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.084693:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6a38b05/0x7ad3e1a879577e57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.084713:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.084718:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.084725:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6a38b05/0x7ad3e1a879577e57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.084740:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6a38b05/0x7ad3e1a879577e57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.084751:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6a38b05/0x7ad3e1a879577e57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.084758:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6a38b05/0x7ad3e1a879577e57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.084800:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788851199.085460:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788851199.085470:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6a38b05/0x7ad3e1a879577e57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851199.085479:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6800 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:3.0:1788851199.085484:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6a38b05/0x7ad3e1a879577e57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851199.085492:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6a38b05/0x7ad3e1a879577e57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851199.085512:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6a38b05/0x7ad3e1a879577e57 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851199.085520:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6a38b05/0x7ad3e1a879577e57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851199.085543:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851199.085545:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851199.085547:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788851199.086470:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.086480:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4d1c289/0x7ad3e1a879577e5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.086499:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.086503:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.086510:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4d1c289/0x7ad3e1a879577e5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.086523:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4d1c289/0x7ad3e1a879577e5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.086531:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4d1c289/0x7ad3e1a879577e5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.086538:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4d1c289/0x7ad3e1a879577e5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.086554:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788851199.087022:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.087028:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe34ccb0/0x7ad3e1a879577e65 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.087036:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.087039:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.087043:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe34ccb0/0x7ad3e1a879577e65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.087052:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe34ccb0/0x7ad3e1a879577e65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.087071:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe34ccb0/0x7ad3e1a879577e65 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.087079:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe34ccb0/0x7ad3e1a879577e65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.087094:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788851199.087491:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.087497:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577e6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.087506:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.087509:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.087513:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577e6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.087521:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577e6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.087529:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577e6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.087536:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577e6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.087562:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788851199.087977:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.087983:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577e73 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.087992:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.087995:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.087999:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577e73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.088007:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577e73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.088014:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577e73 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.088020:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577e73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.088027:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788851199.088429:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.088435:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577e7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.088442:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.088450:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.088454:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577e7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.088464:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577e7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.088471:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577e7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.088479:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577e7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.088486:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788851199.089002:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.089010:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f23e34c4/0x7ad3e1a879577e81 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.089018:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.089021:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.089026:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f23e34c4/0x7ad3e1a879577e81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.089034:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f23e34c4/0x7ad3e1a879577e81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.089044:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f23e34c4/0x7ad3e1a879577e81 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.089765:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f23e34c4/0x7ad3e1a879577e81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.089809:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1788851199.090731:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.090741:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4dcb243/0x7ad3e1a879577e88 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.090755:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.090758:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.090764:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4dcb243/0x7ad3e1a879577e88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.090778:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4dcb243/0x7ad3e1a879577e88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.090820:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4dcb243/0x7ad3e1a879577e88 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.090829:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4dcb243/0x7ad3e1a879577e88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.090840:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1788851199.091282:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.091289:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019323163/0x7ad3e1a879577e8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091487:0:16010:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1788851199.091494:0:16010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4d1c289/0x7ad3e1a879577e5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091503:0:16010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6200 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851199.091507:0:16010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4d1c289/0x7ad3e1a879577e5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091516:0:16010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4d1c289/0x7ad3e1a879577e5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091537:0:16010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4d1c289/0x7ad3e1a879577e5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091544:0:16010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4d1c289/0x7ad3e1a879577e5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091565:0:16010:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788851199.091569:0:16010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe34ccb0/0x7ad3e1a879577e65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091576:0:16010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7a00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851199.091578:0:16010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe34ccb0/0x7ad3e1a879577e65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091593:0:16010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe34ccb0/0x7ad3e1a879577e65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091603:0:16010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe34ccb0/0x7ad3e1a879577e65 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091611:0:16010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe34ccb0/0x7ad3e1a879577e65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091625:0:16010:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788851199.091629:0:16010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577e6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091637:0:16010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7600 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851199.091639:0:16010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577e6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091646:0:16010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577e6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091654:0:16010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577e6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091660:0:16010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001a7c180/0x7ad3e1a879577e6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091684:0:16010:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788851199.091688:0:16010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577e73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091694:0:16010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6a00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851199.091697:0:16010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577e73 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091704:0:16010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577e73 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091713:0:16010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577e73 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091720:0:16010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000173a4336/0x7ad3e1a879577e73 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091731:0:16010:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788851199.091735:0:16010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577e7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091741:0:16010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7e00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851199.091744:0:16010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577e7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091762:0:16010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577e7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091772:0:16010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577e7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091778:0:16010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5356f27/0x7ad3e1a879577e7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091808:0:16010:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851199.091812:0:16010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f23e34c4/0x7ad3e1a879577e81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091819:0:16010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851199.091822:0:16010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f23e34c4/0x7ad3e1a879577e81 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091830:0:16010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f23e34c4/0x7ad3e1a879577e81 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091839:0:16010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f23e34c4/0x7ad3e1a879577e81 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091846:0:16010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f23e34c4/0x7ad3e1a879577e81 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091882:0:16010:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851199.091885:0:16010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4dcb243/0x7ad3e1a879577e88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091891:0:16010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7000 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851199.091894:0:16010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4dcb243/0x7ad3e1a879577e88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091901:0:16010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4dcb243/0x7ad3e1a879577e88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091911:0:16010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4dcb243/0x7ad3e1a879577e88 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091918:0:16010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4dcb243/0x7ad3e1a879577e88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.091930:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.091932:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.091934:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851199.092130:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.092134:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.092141:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019323163/0x7ad3e1a879577e8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.092153:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019323163/0x7ad3e1a879577e8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.092162:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019323163/0x7ad3e1a879577e8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.092169:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019323163/0x7ad3e1a879577e8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.092192:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788851199.092941:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.092949:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fd1a2d7/0x7ad3e1a879577e96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.092960:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.092963:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.092967:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fd1a2d7/0x7ad3e1a879577e96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.092978:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fd1a2d7/0x7ad3e1a879577e96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.093094:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fd1a2d7/0x7ad3e1a879577e96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.093101:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fd1a2d7/0x7ad3e1a879577e96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.093110:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788851199.093447:0:16010:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788851199.093454:0:16010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019323163/0x7ad3e1a879577e8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.093461:0:16010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6000 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851199.093472:0:16010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019323163/0x7ad3e1a879577e8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.093481:0:16010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019323163/0x7ad3e1a879577e8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.093495:0:16010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019323163/0x7ad3e1a879577e8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.093502:0:16010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019323163/0x7ad3e1a879577e8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.093521:0:16010:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851199.093524:0:16010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fd1a2d7/0x7ad3e1a879577e96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.093530:0:16010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7800 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851199.093534:0:16010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fd1a2d7/0x7ad3e1a879577e96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.093541:0:16010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fd1a2d7/0x7ad3e1a879577e96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.093550:0:16010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fd1a2d7/0x7ad3e1a879577e96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.093557:0:16010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fd1a2d7/0x7ad3e1a879577e96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.093577:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.093579:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.093581:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788851199.093951:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.093958:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a879577e9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.093968:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.093971:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.093976:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a879577e9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.093985:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a879577e9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.094143:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a879577e9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.094153:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a879577e9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.094181:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851199.094442:0:16010:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851199.094448:0:16010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a879577e9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.094455:0:16010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6600 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851199.094459:0:16010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a879577e9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.094466:0:16010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a879577e9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.094478:0:16010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a879577e9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.094485:0:16010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a879577e9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.094501:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.094503:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.094505:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788851199.094898:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788851199.094932:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788851199.095820:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.095830:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006253e853/0x7ad3e1a879577ea4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.095843:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.095847:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.095853:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006253e853/0x7ad3e1a879577ea4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.095876:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006253e853/0x7ad3e1a879577ea4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.095884:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006253e853/0x7ad3e1a879577ea4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.095891:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006253e853/0x7ad3e1a879577ea4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.095909:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851199.096524:0:16010:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851199.096532:0:16010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006253e853/0x7ad3e1a879577ea4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.096553:0:16010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b80031200 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851199.096557:0:16010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006253e853/0x7ad3e1a879577ea4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.096567:0:16010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006253e853/0x7ad3e1a879577ea4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.096583:0:16010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006253e853/0x7ad3e1a879577ea4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.096591:0:16010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006253e853/0x7ad3e1a879577ea4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.096613:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.096614:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.096616:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851199.097108:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788851199.098572:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.098583:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082b53a47/0x7ad3e1a879577eab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.098599:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.098611:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.098618:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082b53a47/0x7ad3e1a879577eab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.098632:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082b53a47/0x7ad3e1a879577eab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.098642:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082b53a47/0x7ad3e1a879577eab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.098650:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082b53a47/0x7ad3e1a879577eab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.098711:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788851199.099251:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.099258:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b91cff6e/0x7ad3e1a879577eb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.099266:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.099269:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.099273:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b91cff6e/0x7ad3e1a879577eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.099282:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b91cff6e/0x7ad3e1a879577eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.099290:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b91cff6e/0x7ad3e1a879577eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.099320:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b91cff6e/0x7ad3e1a879577eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.102534:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788851199.102554:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082b53a47/0x7ad3e1a879577eab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.102572:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b80030400 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851199.102579:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082b53a47/0x7ad3e1a879577eab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.102591:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082b53a47/0x7ad3e1a879577eab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.102616:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082b53a47/0x7ad3e1a879577eab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.102637:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082b53a47/0x7ad3e1a879577eab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.102671:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851199.102675:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b91cff6e/0x7ad3e1a879577eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.102682:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b80031800 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851199.102685:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b91cff6e/0x7ad3e1a879577eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.102691:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b91cff6e/0x7ad3e1a879577eb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.102702:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b91cff6e/0x7ad3e1a879577eb2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.102710:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851199.102711:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851199.102713:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851199.107463:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851199.107480:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b91cff6e/0x7ad3e1a879577eb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851199.108230:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.108239:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024e33e53/0x7ad3e1a879577eb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.108254:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.108258:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.108265:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024e33e53/0x7ad3e1a879577eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.108281:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024e33e53/0x7ad3e1a879577eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.108291:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024e33e53/0x7ad3e1a879577eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.108315:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024e33e53/0x7ad3e1a879577eb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.109631:0:16010:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851199.109644:0:16010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024e33e53/0x7ad3e1a879577eb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.109656:0:16010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b80030c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851199.109662:0:16010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024e33e53/0x7ad3e1a879577eb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.109672:0:16010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024e33e53/0x7ad3e1a879577eb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.109703:0:16010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024e33e53/0x7ad3e1a879577eb9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.109715:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.109716:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.109719:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851199.111566:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851199.111581:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024e33e53/0x7ad3e1a879577eb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851199.113716:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.113729:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e24f2b9d/0x7ad3e1a879577ec0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.113749:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.113753:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.113759:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e24f2b9d/0x7ad3e1a879577ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.113774:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e24f2b9d/0x7ad3e1a879577ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.113804:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e24f2b9d/0x7ad3e1a879577ec0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.113813:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e24f2b9d/0x7ad3e1a879577ec0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.115147:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851199.115162:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e24f2b9d/0x7ad3e1a879577ec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.115173:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b80030a00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851199.115187:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e24f2b9d/0x7ad3e1a879577ec0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.115198:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e24f2b9d/0x7ad3e1a879577ec0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.115218:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e24f2b9d/0x7ad3e1a879577ec0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.115348:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.115351:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.115353:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851199.117163:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851199.117180:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e24f2b9d/0x7ad3e1a879577ec0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851199.120135:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.120148:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faf9cce0/0x7ad3e1a879577ec7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.120165:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.120170:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.120178:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faf9cce0/0x7ad3e1a879577ec7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.120194:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faf9cce0/0x7ad3e1a879577ec7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.120206:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faf9cce0/0x7ad3e1a879577ec7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.120214:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faf9cce0/0x7ad3e1a879577ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.121879:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788851199.121892:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faf9cce0/0x7ad3e1a879577ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.121906:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9a83031c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:2.0:1788851199.121912:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faf9cce0/0x7ad3e1a879577ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.121923:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faf9cce0/0x7ad3e1a879577ec7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851199.121943:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faf9cce0/0x7ad3e1a879577ec7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.122415:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.122419:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.122421:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851199.122926:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788851199.122936:0:15073:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faf9cce0/0x7ad3e1a879577ec7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788851199.125977:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.125990:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e98a04a0/0x7ad3e1a879577ece lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.126018:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.126023:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.126029:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e98a04a0/0x7ad3e1a879577ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.126044:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e98a04a0/0x7ad3e1a879577ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.126054:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e98a04a0/0x7ad3e1a879577ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.126061:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e98a04a0/0x7ad3e1a879577ece lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.132319:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851199.132349:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851199.132359:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e98a04a0/0x7ad3e1a879577ece lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.132374:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9a83031800 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851199.132380:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e98a04a0/0x7ad3e1a879577ece lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.132393:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e98a04a0/0x7ad3e1a879577ece lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.132437:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e98a04a0/0x7ad3e1a879577ece lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.132445:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e98a04a0/0x7ad3e1a879577ece lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.132472:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851199.132473:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851199.132475:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788851199.133087:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.133096:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa477120/0x7ad3e1a879577ed5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.133109:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.133113:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.133119:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa477120/0x7ad3e1a879577ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.133132:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa477120/0x7ad3e1a879577ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.133142:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa477120/0x7ad3e1a879577ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.133149:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa477120/0x7ad3e1a879577ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.133177:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788851199.133540:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.133546:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005081a4b7/0x7ad3e1a879577edc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.133554:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.133557:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.133561:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005081a4b7/0x7ad3e1a879577edc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.133570:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005081a4b7/0x7ad3e1a879577edc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.133577:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005081a4b7/0x7ad3e1a879577edc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.133585:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005081a4b7/0x7ad3e1a879577edc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.133593:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788851199.133988:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.133993:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879577ee3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134002:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.134009:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.134013:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879577ee3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134023:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879577ee3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134031:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879577ee3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134038:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879577ee3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134052:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788851199.134065:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788851199.134070:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa477120/0x7ad3e1a879577ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134077:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9a83030400 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851199.134081:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa477120/0x7ad3e1a879577ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134089:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa477120/0x7ad3e1a879577ed5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134102:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa477120/0x7ad3e1a879577ed5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134120:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa477120/0x7ad3e1a879577ed5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134137:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788851199.134141:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005081a4b7/0x7ad3e1a879577edc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134147:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9a83030c00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851199.134150:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005081a4b7/0x7ad3e1a879577edc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134158:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005081a4b7/0x7ad3e1a879577edc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134169:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005081a4b7/0x7ad3e1a879577edc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134176:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005081a4b7/0x7ad3e1a879577edc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134186:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851199.134189:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879577ee3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134194:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9a83031200 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851199.134203:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879577ee3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134210:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879577ee3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134219:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879577ee3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134226:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879577ee3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134238:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851199.134240:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851199.134242:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788851199.134586:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.134592:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a5d649f/0x7ad3e1a879577eea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134600:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.134603:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.134607:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a5d649f/0x7ad3e1a879577eea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134616:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a5d649f/0x7ad3e1a879577eea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134623:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a5d649f/0x7ad3e1a879577eea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134636:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a5d649f/0x7ad3e1a879577eea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134649:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788851199.134657:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788851199.134661:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a5d649f/0x7ad3e1a879577eea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134667:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9a83030a00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851199.134670:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a5d649f/0x7ad3e1a879577eea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134678:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a5d649f/0x7ad3e1a879577eea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134689:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a5d649f/0x7ad3e1a879577eea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134696:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a5d649f/0x7ad3e1a879577eea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.134708:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851199.134709:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851199.134711:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.135768:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.135809:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.135814:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788851199.136540:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788851199.136559:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf3a813/0x7ad3e1a879577ef1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.136575:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=532s v=(0 0) 00010000:00010000:0.0:1788851199.136580:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851199.136585:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bf3a813/0x7ad3e1a879577ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.136597:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bf3a813/0x7ad3e1a879577ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.136607:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf3a813/0x7ad3e1a879577ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.136615:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bf3a813/0x7ad3e1a879577ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.136679:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788851199.137116:0:14376:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851199.137123:0:14376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bf3a813/0x7ad3e1a879577ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.137131:0:14376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9a83031a00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851199.137135:0:14376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf3a813/0x7ad3e1a879577ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.137145:0:14376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf3a813/0x7ad3e1a879577ef1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.137162:0:14376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bf3a813/0x7ad3e1a879577ef1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.137177:0:14376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bf3a813/0x7ad3e1a879577ef1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.137196:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.137198:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.137199:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788851199.149760:0:15073:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788851199.149773:0:15073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577ef8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.150517:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=532s v=(0 0) 00010000:00010000:1.0:1788851199.150522:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788851199.150528:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.150544:0:15073:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.150555:0:15073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.150563:0:15073:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851199.153539:0:15073:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788851199.153973:0:15073:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1788851199.154145:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14413:x1875746019710848:12345-0@lo:5:osp-pre-1-0.0 Request processed in 134950us (135856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851199.154156:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788851199.154272:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14413:1875746019710848:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788851199.154289:0:14413:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788851199.154530:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb45a5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14413:1875746019710976:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788851199.154569:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851199.154628:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb401b180 going to sleep for 11 seconds 00010000:00010000:1.0:1788851199.154695:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851199.154705:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.154724:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59e00 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851199.154728:0:14377:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.154739:0:14377:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577ef8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.154757:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577ef8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.154764:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa38e9eb/0x7ad3e1a879577ef8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851199.154817:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.154820:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851199.154822:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851199.155227:0:16008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019710976 00000100:00100000:0.0:1788851199.155236:0:16008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019710976 00000100:00100000:0.0:1788851199.155290:0:16008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788851199.155495:0:16008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14413:x1875746019710976:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788851199.155541:0:16008:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788851199.172041:0:16008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14413:x1875746019710976:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16734us (17463us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788851199.172055:0:16008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788851199.172572:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb45a5880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14413:1875746019710976:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788851199.172591:0:14413:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788851199.517412:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788851199.648503:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788851199.648568:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788851200.531161:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851201.557405:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788851201.745767:0:16150:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg406-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788851202.070435:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019711104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851202.070508:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851202.070595:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019711104 00000100:00100000:1.0:1788851202.070603:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019711104 00000100:00100000:1.0:1788851202.070657:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788851202.070668:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019711104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851202.070705:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851202.070755:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf041f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019711104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851202.070774:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788851202.070821:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788851202.070860:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019711104:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788851202.578312:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851203.602114:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788851204.050831:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788851204.114450:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019711232:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851204.114522:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851204.114593:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019711232 00000100:00100000:1.0:1788851204.114600:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019711232 00000100:00100000:1.0:1788851204.114668:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788851204.114679:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019711232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788851204.114717:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851204.114816:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf041500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019711232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851204.114823:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788851204.114845:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851204.114931:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019711488:0@lo:400:kworker.0 00000100:00100000:1.0:1788851204.114961:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851204.114990:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851204.114996:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019711616:0@lo:400:kworker.0 00000100:00100000:1.0:1788851204.115022:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851204.115066:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3311:1875746019711360:0@lo:400:kworker.0 00000100:00100000:1.0:1788851204.115107:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851204.115129:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019711872:0@lo:400:kworker.0 00000100:00100000:1.0:1788851204.115151:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851204.115852:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019711616 00000100:00100000:0.0:1788851204.115860:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019711616 00000100:00100000:0.0:1788851204.115893:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019711872 00000100:00100000:0.0:1788851204.115897:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019711872 00000100:00100000:0.0:1788851204.115926:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788851204.115935:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019711616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851204.115990:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf043480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019711616:12345-0@lo:400:kworker.0 Request processed in 56us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851204.115997:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788851204.116012:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788851204.116019:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019711872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851204.117467:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788851204.117496:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019711744:0@lo:400:kworker.0 00000100:00100000:2.0:1788851204.117857:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019711488 00000100:00100000:2.0:1788851204.117866:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019711488 00000100:00100000:2.0:1788851204.117928:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788851204.117938:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019711488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851204.121894:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851204.121962:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019711360 00000100:00100000:1.0:1788851204.121971:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019711360 00000100:00100000:1.0:1788851204.122043:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788851204.122065:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:3311:x1875746019711360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851204.122417:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:3311:x1875746019711360:12345-0@lo:400:kworker.0 Request processed in 353us (7308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851204.122427:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788851204.122462:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019711744 00000100:00100000:1.0:1788851204.122466:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019711744 00000100:00100000:1.0:1788851204.122494:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788851204.122500:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019711744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851204.122532:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf042d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875746019711744:12345-0@lo:400:kworker.0 Request processed in 32us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851204.122539:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788851204.122578:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788851204.122601:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf043100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019711232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851204.122798:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf042680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875746019711872:12345-0@lo:400:kworker.0 Request processed in 6778us (7644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851204.122807:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788851204.122844:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851204.122850:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788851204.122874:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf040000 x1875746019711616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788851204.122888:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019711616:0@lo:400:kworker.0 00010000:00080000:1.0:1788851204.124067:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf041180 x1875746019711744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851204.125581:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf041180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1875746019711744:0@lo:400:kworker.0 00000100:00100000:1.0:1788851204.125614:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3311:1875746019711360:0@lo:400:kworker.0 00010000:00080000:1.0:1788851204.125633:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8a9baf040700 x1875746019711872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788851220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788851204.125641:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1875746019711872:0@lo:400:kworker.0 00000100:00100000:2.0:1788851204.127011:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf041c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019711488:12345-0@lo:400:kworker.0 Request processed in 9068us (12041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851204.127027:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788851204.127888:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019711488:0@lo:400:kworker.0 00000100:00100000:1.0:1788851204.461014:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851204.464386:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000839680 00000100:00100000:0.0:1788851204.464402:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000839680 00000100:00100000:0.0:1788851204.464465:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 78 00000100:00100000:0.0:1788851204.464474:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2350:x1875746000839680:12345-192.168.204.6@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788851204.464523:0:14382:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from a9650a6c-0a31-41c0-9a66-788e070d6102@192.168.204.6@tcp t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:0.0:1788851204.464558:0:14382:0:(genops.c:1384:class_connect()) connect: client a9650a6c-0a31-41c0-9a66-788e070d6102, cookie 0x7ad3e1a879577eff 00000100:00080000:0.0:1788851204.464697:0:14382:0:(import.c:65:import_set_state_nolock()) ffff8a9a82fa6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788851204.464834:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+5:2350:x1875746000839680:12345-192.168.204.6@tcp:250:mount.lustre.0 Request processed in 359us (3830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851204.464843:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 78 00000100:00100000:3.0:1788851204.478332:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851204.480109:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000839808 00000100:00100000:0.0:1788851204.480128:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000839808 00000100:00100000:0.0:1788851204.480239:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 79 00000100:00100000:0.0:1788851204.480248:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+5:13771:x1875746000839808:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788851204.480265:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851204.480284:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9a83031000/0x7ad3e1a879577f06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee65 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851204.480315:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9a83031000/0x7ad3e1a879577f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee65 expref: 6 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851204.480327:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9a83031000/0x7ad3e1a879577f06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee65 expref: 6 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851204.480336:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9a83031000, rc 0) 00000100:00100000:0.0:1788851204.480415:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+6:13771:x1875746000839808:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 168us (2094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851204.480422:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 79 00000100:00100000:2.0:1788851204.483363:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851204.483461:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000839936 00000100:00100000:1.0:1788851204.483471:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000839936 00000100:00100000:1.0:1788851204.483527:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 80 00000100:00100000:1.0:1788851204.483537:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+6:13771:x1875746000839936:12345-192.168.204.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788851204.483891:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4499450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+6:13771:x1875746000839936:12345-192.168.204.6@tcp:501:mount.lustre.0 Request processed in 355us (539us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788851204.483898:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 80 00000100:00100000:1.0:1788851204.490047:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851204.490180:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840064 00000100:00100000:2.0:1788851204.490203:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840064 00000100:00100000:2.0:1788851204.490260:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 81 00000100:00100000:2.0:1788851204.490269:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+6:13771:x1875746000840064:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788851204.490286:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851204.490306:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b90546200/0x7ad3e1a879577f0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee6c expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851204.490335:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90546200/0x7ad3e1a879577f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee6c expref: 7 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851204.490344:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b90546200/0x7ad3e1a879577f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee6c expref: 7 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851204.490352:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90546200, rc 0) 00000100:00100000:2.0:1788851204.490414:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+7:13771:x1875746000840064:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 146us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851204.490422:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 81 00000100:00100000:3.0:1788851204.496529:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851204.497685:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840192 00000100:00100000:0.0:1788851204.497699:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840192 00000100:00100000:0.0:1788851204.498005:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 82 00000100:00100000:0.0:1788851204.498031:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+7:13771:x1875746000840192:12345-192.168.204.6@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788851204.499461:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4498450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+8:13771:x1875746000840192:12345-192.168.204.6@tcp:501:mount.lustre.0 Request processed in 1419us (4171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851204.499478:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 82 00000100:00100000:0.0:1788851204.504465:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851204.504773:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840320 00000100:00100000:1.0:1788851204.504879:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840320 00000100:00100000:1.0:1788851204.505189:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 83 00000100:00100000:1.0:1788851204.506396:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+8:13771:x1875746000840320:12345-192.168.204.6@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788851204.507398:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4499c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+8:13771:x1875746000840320:12345-192.168.204.6@tcp:503:mount.lustre.0 Request processed in 2191us (3003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851204.507411:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 83 00000100:00100000:1.0:1788851204.519064:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851204.519133:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840448 00000100:00100000:0.0:1788851204.519146:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840448 00000100:00100000:0.0:1788851204.519210:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 84 00000100:00100000:0.0:1788851204.519221:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+8:13790:x1875746000840448:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788851204.521550:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+8:13790:x1875746000840448:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 2320us (2483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851204.521566:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 84 00000100:00100000:3.0:1788851204.549580:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851204.550320:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840576 00000100:00100000:1.0:1788851204.550332:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840576 00000100:00100000:1.0:1788851204.550403:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 85 00000100:00100000:1.0:1788851204.550414:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+8:13790:x1875746000840576:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788851204.550742:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+8:13790:x1875746000840576:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 329us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851204.550761:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 85 00000100:00100000:1.0:1788851204.560364:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851204.560660:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840704 00000100:00100000:2.0:1788851204.560673:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840704 00000100:00100000:2.0:1788851204.560733:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 86 00000100:00100000:2.0:1788851204.560744:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+8:13771:x1875746000840704:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788851204.560773:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851204.560825:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b90547400/0x7ad3e1a879577f14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee96 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851204.560856:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90547400/0x7ad3e1a879577f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee96 expref: 9 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851204.560867:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b90547400/0x7ad3e1a879577f14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee96 expref: 9 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851204.560878:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547400, rc 0) 00000100:00100000:2.0:1788851204.560958:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4498050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+9:13771:x1875746000840704:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 203us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851204.560965:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 86 00000100:00100000:3.0:1788851204.566329:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851204.566504:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840832 00000100:00100000:2.0:1788851204.566516:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840832 00000100:00100000:2.0:1788851204.566579:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 87 00000100:00100000:2.0:1788851204.566589:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+9:13771:x1875746000840832:12345-192.168.204.6@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788851204.566617:0:14382:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788851204.566654:0:14382:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788851204.566659:0:14382:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788851204.566661:0:14382:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788851204.566663:0:14382:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788851204.570899:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+9:13771:x1875746000840832:12345-192.168.204.6@tcp:256:mount.lustre.0 Request processed in 4292us (4560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851204.570925:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 87 00000100:00100000:1.0:1788851204.590974:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851204.591112:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000840960 00000100:00100000:2.0:1788851204.591124:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000840960 00000100:00100000:2.0:1788851204.591176:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 88 00000100:00100000:2.0:1788851204.591187:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+9:13771:x1875746000840960:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788851204.591396:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851204.591417:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577f1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfee9d expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851204.591449:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577f1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee9d expref: 10 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851204.591460:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577f1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee9d expref: 10 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851204.591469:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b90547200, rc 0) 00000100:00100000:2.0:1788851204.595331:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4498850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+10:13771:x1875746000840960:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 3891us (4113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851204.595345:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 88 00000100:00100000:3.0:1788851204.597733:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851204.599346:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000841088 00000100:00100000:2.0:1788851204.599360:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000841088 00000100:00100000:2.0:1788851204.599545:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 89 00000100:00100000:2.0:1788851204.599555:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+10:13771:x1875746000841088:12345-192.168.204.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788851204.599929:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+10:13771:x1875746000841088:12345-192.168.204.6@tcp:501:mount.lustre.0 Request processed in 374us (2203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851204.599938:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 89 00000100:00100000:3.0:1788851204.602995:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851204.603223:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000841216 00000100:00100000:2.0:1788851204.603233:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000841216 00000100:00100000:2.0:1788851204.603284:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 90 00000100:00100000:2.0:1788851204.603294:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+10:13771:x1875746000841216:12345-192.168.204.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788851204.604108:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+10:13771:x1875746000841216:12345-192.168.204.6@tcp:503:mount.lustre.0 Request processed in 812us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851204.604119:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 90 00000100:00100000:0.0:1788851204.613516:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851204.613610:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000841344 00000100:00100000:2.0:1788851204.613621:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000841344 00000100:00100000:2.0:1788851204.613691:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 91 00000100:00100000:2.0:1788851204.613700:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+10:13795:x1875746000841344:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788851204.615224:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+10:13795:x1875746000841344:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 1517us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851204.615237:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 91 00000100:00100000:0.0:1788851204.620490:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851204.621458:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000841472 00000100:00100000:2.0:1788851204.621472:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000841472 00000100:00100000:2.0:1788851204.621597:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 92 00000100:00100000:2.0:1788851204.621609:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+10:13795:x1875746000841472:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788851204.622772:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+10:13795:x1875746000841472:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 1157us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851204.624154:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 92 00000100:00100000:1.0:1788851204.631835:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851204.631921:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000841600 00000100:00100000:0.0:1788851204.631931:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000841600 00000100:00100000:0.0:1788851204.631976:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:0.0:1788851204.631985:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1875746000841600:12345-192.168.204.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788851204.632015:0:14388:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a20f2a44-3f34-4fab-952c-679d966a5b8b@192.168.204.6@tcp t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:0.0:1788851204.632075:0:14388:0:(genops.c:1384:class_connect()) connect: client a20f2a44-3f34-4fab-952c-679d966a5b8b, cookie 0x7ad3e1a879577f22 00000004:00100000:0.0:1788851204.632105:0:14388:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788851204.632111:0:14388:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788851204.632895:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788851204.681476:0:14388:0:(import.c:65:import_set_state_nolock()) ffff8a9b83f1f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851204.681678:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf040700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:2350:x1875746000841600:12345-192.168.204.6@tcp:38:mount.lustre.0 Request processed in 49691us (49851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851204.682095:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:1.0:1788851204.689308:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851204.689355:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851204.689512:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000841728 00000100:00100000:0.0:1788851204.689524:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000841728 00000100:00100000:0.0:1788851204.689611:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000841856 00000100:00100000:0.0:1788851204.689615:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000841856 00000100:00100000:0.0:1788851204.689659:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:0.0:1788851204.689670:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+7:0:x1875746000841728:12345-192.168.204.6@tcp:41:mount.lustre.0 00000100:00100000:3.0:1788851204.689853:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:3.0:1788851204.689863:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+7:13771:x1875746000841856:12345-192.168.204.6@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788851204.689924:0:15800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788851204.690041:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf041180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+7:13771:x1875746000841856:12345-192.168.204.6@tcp:41:mount.lustre.0 Request processed in 179us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851204.690049:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 6 00000004:00000024:0.0:1788851204.691370:0:14390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788851204.691447:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf042300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:0:x1875746000841728:12345-192.168.204.6@tcp:41:mount.lustre.0 Request processed in 1774us (2153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851204.691455:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00080000:1.0:1788851204.692758:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851204.697310:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851204.697515:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000841984 00000100:00100000:3.0:1788851204.697542:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000841984 00000100:00100000:3.0:1788851204.697763:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:3.0:1788851204.697776:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:13771:x1875746000841984:12345-192.168.204.6@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788851204.697934:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf043100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:13771:x1875746000841984:12345-192.168.204.6@tcp:40:mount.lustre.0 Request processed in 160us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851204.697942:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:3.0:1788851204.706403:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851204.706446:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851204.706982:0:16008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000842112 00000100:00100000:0.0:1788851204.706992:0:16008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000842112 00000100:00100000:0.0:1788851204.707143:0:16008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000842240 00000100:00100000:0.0:1788851204.707147:0:16008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000842240 00000100:00100000:3.0:1788851204.709562:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851204.709984:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000842368 00000100:00100000:3.0:1788851204.709994:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000842368 00000100:00100000:3.0:1788851204.710304:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:3.0:1788851204.710316:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:13771:x1875746000842368:12345-192.168.204.6@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788851204.712294:0:14391:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1861us 00000100:00100000:1.0:1788851204.712504:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:1.0:1788851204.712514:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2350:x1875746000842112:12345-192.168.204.6@tcp:8:mount.lustre.0 00000100:00100000:2.0:1788851204.712542:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:2.0:1788851204.712550:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875746000842240:12345-192.168.204.6@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788851204.712550:0:15074:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a20f2a44-3f34-4fab-952c-679d966a5b8b@192.168.204.6@tcp t0 exp 0000000000000000 cur 537 last 0 00010000:00080000:2.0:1788851204.712566:0:15073:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a20f2a44-3f34-4fab-952c-679d966a5b8b@192.168.204.6@tcp t0 exp 0000000000000000 cur 537 last 0 00000020:00000080:1.0:1788851204.712584:0:15074:0:(genops.c:1384:class_connect()) connect: client a20f2a44-3f34-4fab-952c-679d966a5b8b, cookie 0x7ad3e1a879577f29 00000020:00000080:2.0:1788851204.712593:0:15073:0:(genops.c:1384:class_connect()) connect: client a20f2a44-3f34-4fab-952c-679d966a5b8b, cookie 0x7ad3e1a879577f30 00002000:00100000:1.0:1788851204.712971:0:15074:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a20f2a44-3f34-4fab-952c-679d966a5b8b/ffff8a9b83f1a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788851204.712997:0:15074:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00100000:2.0:1788851204.713968:0:15073:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a20f2a44-3f34-4fab-952c-679d966a5b8b/ffff8a9ba0466000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788851204.713980:0:15073:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788851204.714228:0:15073:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788851204.714265:0:15073:0:(import.c:65:import_set_state_nolock()) ffff8a9ba0462800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851204.714341:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:2350:x1875746000842240:12345-192.168.204.6@tcp:8:mount.lustre.0 Request processed in 1789us (7893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851204.714350:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 10 00002000:00080000:1.0:1788851204.714970:0:15074:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788851204.714992:0:15074:0:(import.c:65:import_set_state_nolock()) ffff8a9b83f19000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851204.715026:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:2350:x1875746000842112:12345-192.168.204.6@tcp:8:mount.lustre.0 Request processed in 2510us (8641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851204.715033:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00000004:00200000:3.0:1788851204.736192:0:14391:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788851204.736313:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:13771:x1875746000842368:12345-192.168.204.6@tcp:33:mount.lustre.0 Request processed in 25993us (26756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851204.736326:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:2.0:1788851205.000880:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851205.001112:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000842496 00000100:00100000:0.0:1788851205.001123:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000842496 00000100:00100000:0.0:1788851205.001185:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:0.0:1788851205.001196:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:13816:x1875746000842496:12345-192.168.204.6@tcp:101:mkdir.0 00010000:00010000:0.0:1788851205.001219:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851205.001247:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a879577f37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeec7 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851205.001315:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030e00/0x7ad3e1a879577f3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851205.001343:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030e00/0x7ad3e1a879577f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851205.001359:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030e00/0x7ad3e1a879577f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851205.001395:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788851205.001399:0:14388:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788851205.001453:0:14388:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030e00/0x7ad3e1a879577f3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851205.001478:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a879577f37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeec7 expref: 8 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851205.001495:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030e00/0x7ad3e1a879577f3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeec7 expref: 7 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851205.001502:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b990e2b00) 00010000:00010000:0.0:1788851205.001505:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851205.001509:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9a83030e00, rc 0) 00000100:00100000:0.0:1788851205.001627:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4168000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+7:13816:x1875746000842496:12345-192.168.204.6@tcp:101:mkdir.0 Request processed in 432us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851205.001634:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00010000:00010000:1.0:1788851205.650465:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851206.674168:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851207.052587:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851207.052775:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000842624 00000100:00100000:1.0:1788851207.052809:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000842624 00000100:00100000:1.0:1788851207.052895:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:1.0:1788851207.052910:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+7:13869:x1875746000842624:12345-192.168.204.6@tcp:41:lfs.0 00000004:00000024:1.0:1788851207.052987:0:15800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788851207.053096:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+7:13869:x1875746000842624:12345-192.168.204.6@tcp:41:lfs.0 Request processed in 190us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851207.053103:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00080000:0.0:1788851207.053427:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851207.059485:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851207.059609:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000842752 00000100:00100000:1.0:1788851207.059624:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000842752 00000100:00100000:1.0:1788851207.060162:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:1.0:1788851207.060176:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:13869:x1875746000842752:12345-192.168.204.6@tcp:13:lfs.0 00002000:00000024:1.0:1788851207.060220:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851207.060317:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:13869:x1875746000842752:12345-192.168.204.6@tcp:13:lfs.0 Request processed in 144us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851207.060323:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00080000:0.0:1788851207.060399:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851207.065084:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851207.068083:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000842880 00000100:00100000:1.0:1788851207.068100:0:15077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000842880 00000100:00080000:0.0:1788851207.068481:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788851207.073072:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:1.0:1788851207.073103:0:15077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:13869:x1875746000842880:12345-192.168.204.6@tcp:13:lfs.0 00000100:00100000:2.0:1788851207.073452:0:15075:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788851207.073467:0:15075:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1788851207.073957:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851207.074071:0:15077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:13869:x1875746000842880:12345-192.168.204.6@tcp:13:lfs.0 Request processed in 980us (8992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851207.074095:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:0.0:1788851207.186832:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019712000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851207.187202:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851207.187994:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712000 00000100:00100000:2.0:1788851207.188005:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712000 00000100:00080000:0.0:1788851207.188185:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851207.189876:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788851207.189898:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019712000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788851207.189930:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788851207.190607:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019712000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 717us (3403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851207.190616:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788851207.190725:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf042a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019712000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851207.324297:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851207.330425:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000843008 00000100:00100000:2.0:1788851207.330450:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000843008 00000100:00100000:2.0:1788851207.330556:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 93 00000100:00100000:2.0:1788851207.330571:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+10:13904:x1875746000843008:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788851207.330593:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851207.330620:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577f45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeece expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851207.332316:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeece expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851207.332338:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b98af6c00/0x7ad3e1a879577f45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeece expref: 11 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851207.332352:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6c00, rc 0) 00000100:00100000:2.0:1788851207.332541:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+11:13904:x1875746000843008:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 1970us (8260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851207.332552:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 93 00000100:00100000:2.0:1788851207.345401:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851207.345533:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000843136 00000100:00100000:1.0:1788851207.345550:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000843136 00000100:00100000:1.0:1788851207.345641:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 94 00000100:00100000:1.0:1788851207.345657:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+11:13904:x1875746000843136:12345-192.168.204.6@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788851207.346225:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+11:13904:x1875746000843136:12345-192.168.204.6@tcp:501:mount.lustre.0 Request processed in 570us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851207.346236:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 94 00000100:00100000:1.0:1788851207.355127:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851207.355377:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000843264 00000100:00100000:2.0:1788851207.355398:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000843264 00000100:00100000:2.0:1788851207.356023:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 95 00000100:00100000:2.0:1788851207.356040:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+11:13904:x1875746000843264:12345-192.168.204.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788851207.356417:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+11:13904:x1875746000843264:12345-192.168.204.6@tcp:503:mount.lustre.0 Request processed in 379us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851207.356427:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 95 00000100:00100000:0.0:1788851207.367326:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851207.368525:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000843392 00000100:00100000:1.0:1788851207.368545:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000843392 00000100:00100000:1.0:1788851207.368653:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 96 00000100:00100000:1.0:1788851207.368667:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+11:13908:x1875746000843392:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788851207.374333:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+11:13908:x1875746000843392:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 5651us (7008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851207.374353:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 96 00000100:00100000:3.0:1788851207.391772:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851207.392042:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000843520 00000100:00100000:2.0:1788851207.392059:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000843520 00000100:00100000:2.0:1788851207.392142:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 97 00000100:00100000:2.0:1788851207.392154:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+11:13908:x1875746000843520:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788851207.392548:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+11:13908:x1875746000843520:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 394us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851207.392558:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 97 00000100:00100000:2.0:1788851207.399901:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851207.401205:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000843648 00000100:00100000:1.0:1788851207.401222:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000843648 00000100:00100000:1.0:1788851207.401321:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 98 00000100:00100000:1.0:1788851207.401335:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+11:13904:x1875746000843648:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788851207.401358:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851207.401384:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9baef58e00/0x7ad3e1a879577f4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeef8 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851207.401428:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9baef58e00/0x7ad3e1a879577f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeef8 expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851207.401442:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9baef58e00/0x7ad3e1a879577f4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeef8 expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851207.401452:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58e00, rc 0) 00000100:00100000:1.0:1788851207.401557:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+12:13904:x1875746000843648:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 224us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851207.401564:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 98 00000100:00100000:0.0:1788851207.415504:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851207.415760:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000843776 00000100:00100000:1.0:1788851207.415777:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000843776 00000100:00100000:1.0:1788851207.415907:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 99 00000100:00100000:1.0:1788851207.415920:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+12:13904:x1875746000843776:12345-192.168.204.6@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788851207.415968:0:14380:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788851207.416011:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788851207.416017:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788851207.416020:0:14380:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788851207.416022:0:14380:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788851207.429565:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+12:13904:x1875746000843776:12345-192.168.204.6@tcp:256:mount.lustre.0 Request processed in 13631us (14062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851207.429585:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 99 00000100:00100000:2.0:1788851207.441405:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851207.448377:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000843904 00000100:00100000:0.0:1788851207.448407:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000843904 00000100:00100000:0.0:1788851207.449351:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 100 00000100:00100000:0.0:1788851207.449367:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+12:13904:x1875746000843904:12345-192.168.204.6@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788851207.449394:0:14382:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851207.449453:0:14382:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9a83031e00/0x7ad3e1a879577f53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeeff expref: -99 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851207.449495:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9a83031e00/0x7ad3e1a879577f53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeeff expref: 13 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851207.449509:0:14382:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9a83031e00/0x7ad3e1a879577f53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeeff expref: 13 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851207.449521:0:14382:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9a83031e00, rc 0) 00000100:00100000:0.0:1788851207.449639:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+13:13904:x1875746000843904:12345-192.168.204.6@tcp:101:mount.lustre.0 Request processed in 275us (8249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851207.449648:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 100 00000100:00100000:1.0:1788851207.461182:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851207.467315:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844032 00000100:00100000:2.0:1788851207.467332:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844032 00000100:00100000:2.0:1788851207.467457:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 101 00000100:00100000:2.0:1788851207.467468:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+13:13904:x1875746000844032:12345-192.168.204.6@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788851207.467895:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+13:13904:x1875746000844032:12345-192.168.204.6@tcp:501:mount.lustre.0 Request processed in 427us (6728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851207.467904:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 101 00000100:00100000:3.0:1788851207.471093:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851207.471703:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844160 00000100:00100000:2.0:1788851207.471719:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844160 00000100:00100000:2.0:1788851207.472069:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 102 00000100:00100000:2.0:1788851207.472083:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+13:13904:x1875746000844160:12345-192.168.204.6@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788851207.472528:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+13:13904:x1875746000844160:12345-192.168.204.6@tcp:503:mount.lustre.0 Request processed in 447us (1565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851207.472537:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 102 00000100:00100000:3.0:1788851207.476934:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851207.478115:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844288 00000100:00100000:1.0:1788851207.478136:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844288 00000100:00100000:1.0:1788851207.478240:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 103 00000100:00100000:1.0:1788851207.478254:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+13:13912:x1875746000844288:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788851207.479430:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+13:13912:x1875746000844288:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 524us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851207.479447:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 103 00000100:00100000:1.0:1788851207.488566:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851207.488746:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844416 00000100:00100000:0.0:1788851207.488762:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844416 00000100:00100000:0.0:1788851207.488885:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 104 00000100:00100000:0.0:1788851207.488899:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb449cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+13:13912:x1875746000844416:12345-192.168.204.6@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788851207.489734:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb449cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+13:13912:x1875746000844416:12345-192.168.204.6@tcp:502:llog_process_th.0 Request processed in 831us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851207.489748:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 104 00000100:00100000:3.0:1788851207.523110:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851207.523722:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844544 00000100:00100000:0.0:1788851207.523739:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844544 00000100:00100000:0.0:1788851207.523857:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:0.0:1788851207.523875:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2350:x1875746000844544:12345-192.168.204.6@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788851207.523918:0:14388:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ee5876d3-dac7-4454-b807-f34f3453286e@192.168.204.6@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:0.0:1788851207.523984:0:14388:0:(genops.c:1384:class_connect()) connect: client ee5876d3-dac7-4454-b807-f34f3453286e, cookie 0x7ad3e1a879577f5a 00000004:00100000:0.0:1788851207.524026:0:14388:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788851207.524240:0:14388:0:(import.c:65:import_set_state_nolock()) ffff8a9a82fa5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788851207.524773:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ee5876d3-dac7-4454-b807-f34f3453286e+6:2350:x1875746000844544:12345-192.168.204.6@tcp:38:mount.lustre.0 Request processed in 895us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851207.524804:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:3.0:1788851207.537643:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851207.539442:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851207.545930:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844800 00000100:00100000:0.0:1788851207.545957:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844800 00000100:00100000:1.0:1788851207.546092:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844672 00000100:00100000:1.0:1788851207.546100:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844672 00000100:00100000:0.0:1788851207.546101:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:0.0:1788851207.546117:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee5876d3-dac7-4454-b807-f34f3453286e+7:13904:x1875746000844800:12345-192.168.204.6@tcp:41:mount.lustre.0 00000100:00100000:1.0:1788851207.546147:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:1.0:1788851207.546158:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee5876d3-dac7-4454-b807-f34f3453286e+7:0:x1875746000844672:12345-192.168.204.6@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788851207.546188:0:15800:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:0.0:1788851207.546188:0:14390:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1788851207.546231:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788851207.546294:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee5876d3-dac7-4454-b807-f34f3453286e+7:0:x1875746000844672:12345-192.168.204.6@tcp:41:mount.lustre.0 Request processed in 138us (9005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851207.546303:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:0.0:1788851207.548039:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee5876d3-dac7-4454-b807-f34f3453286e+6:13904:x1875746000844800:12345-192.168.204.6@tcp:41:mount.lustre.0 Request processed in 1848us (8532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851207.548056:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:1.0:1788851207.551948:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851207.552120:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000844928 00000100:00100000:3.0:1788851207.552135:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000844928 00000100:00100000:3.0:1788851207.552231:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:3.0:1788851207.552244:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee5876d3-dac7-4454-b807-f34f3453286e+6:13904:x1875746000844928:12345-192.168.204.6@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788851207.552387:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf042a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee5876d3-dac7-4454-b807-f34f3453286e+6:13904:x1875746000844928:12345-192.168.204.6@tcp:40:mount.lustre.0 Request processed in 145us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851207.552395:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:2.0:1788851207.558364:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851207.558493:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851207.558598:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851207.558747:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000845312 00000100:00100000:3.0:1788851207.558762:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000845312 00000100:00100000:3.0:1788851207.558872:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:3.0:1788851207.558885:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee5876d3-dac7-4454-b807-f34f3453286e+6:13904:x1875746000845312:12345-192.168.204.6@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788851207.558991:0:14392:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788851207.559098:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4168a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee5876d3-dac7-4454-b807-f34f3453286e+6:13904:x1875746000845312:12345-192.168.204.6@tcp:33:mount.lustre.0 Request processed in 216us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851207.559107:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:0.0:1788851207.559450:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000845056 00000100:00100000:0.0:1788851207.559456:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000845056 00000100:00100000:0.0:1788851207.559496:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000845184 00000100:00100000:0.0:1788851207.559499:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000845184 00000100:00100000:0.0:1788851207.559526:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:0.0:1788851207.559532:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2350:x1875746000845056:12345-192.168.204.6@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788851207.559563:0:15073:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ee5876d3-dac7-4454-b807-f34f3453286e@192.168.204.6@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:0.0:1788851207.559610:0:15073:0:(genops.c:1384:class_connect()) connect: client ee5876d3-dac7-4454-b807-f34f3453286e, cookie 0x7ad3e1a879577f61 00000100:00100000:2.0:1788851207.559728:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:2.0:1788851207.559735:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2350:x1875746000845184:12345-192.168.204.6@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788851207.559754:0:15072:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ee5876d3-dac7-4454-b807-f34f3453286e@192.168.204.6@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:2.0:1788851207.559777:0:15072:0:(genops.c:1384:class_connect()) connect: client ee5876d3-dac7-4454-b807-f34f3453286e, cookie 0x7ad3e1a879577f68 00002000:00100000:0.0:1788851207.559949:0:15073:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ee5876d3-dac7-4454-b807-f34f3453286e/ffff8a9a82fa6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788851207.559967:0:15073:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788851207.560124:0:15073:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788851207.560164:0:15073:0:(import.c:65:import_set_state_nolock()) ffff8a9a82fa2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788851207.560214:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4168380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ee5876d3-dac7-4454-b807-f34f3453286e+6:2350:x1875746000845056:12345-192.168.204.6@tcp:8:mount.lustre.0 Request processed in 681us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851207.560222:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 11 00002000:00100000:2.0:1788851207.563549:0:15072:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ee5876d3-dac7-4454-b807-f34f3453286e/ffff8a9b8da6c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788851207.563580:0:15072:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788851207.563862:0:15072:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788851207.563930:0:15072:0:(import.c:65:import_set_state_nolock()) ffff8a9b8da6e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788851207.564052:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee5876d3-dac7-4454-b807-f34f3453286e+6:2350:x1875746000845184:12345-192.168.204.6@tcp:8:mount.lustre.0 Request processed in 4313us (5555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851207.564066:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 12 00010000:00010000:3.0:1788851207.699812:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851207.727033:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851207.727337:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000845440 00000100:00100000:0.0:1788851207.727502:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000845440 00000100:00100000:0.0:1788851207.729465:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:0.0:1788851207.729488:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb416ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee5876d3-dac7-4454-b807-f34f3453286e+6:13933:x1875746000845440:12345-192.168.204.6@tcp:101:mkdir.0 00010000:00010000:0.0:1788851207.729521:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851207.729562:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030800/0x7ad3e1a879577f6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef29 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851207.729674:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a879577f76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851207.729707:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a879577f76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851207.729727:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a879577f76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851207.729776:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788851207.730109:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788851207.730153:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a879577f76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851207.730188:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030800/0x7ad3e1a879577f6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef29 expref: 8 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851207.730212:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a879577f76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef29 expref: 7 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851207.730221:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b990e2b00) 00010000:00010000:0.0:1788851207.730224:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851207.730228:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9a83031400, rc 0) 00000100:00100000:0.0:1788851207.730342:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb416ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee5876d3-dac7-4454-b807-f34f3453286e+7:13933:x1875746000845440:12345-192.168.204.6@tcp:101:mkdir.0 Request processed in 862us (3324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851207.731242:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 14 00000001:00100000:3.0:1788851208.263668:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ee5876d3-dac7-4454-b807-f34f3453286e 00000001:00100000:3.0:1788851208.263700:0:6732:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a20f2a44-3f34-4fab-952c-679d966a5b8b 00010000:00010000:1.0:1788851208.725943:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851209.234027:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851209.234053:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019712128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851209.234134:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851209.234171:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3310:1875746019712256:0@lo:400:kworker.0 00000100:00100000:3.0:1788851209.234211:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019712512:0@lo:400:kworker.0 00000100:00100000:1.0:1788851209.234220:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851209.234245:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851209.234257:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019712768:0@lo:400:kworker.0 00000100:00100000:3.0:1788851209.234269:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788851209.234291:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851209.234295:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019712640:0@lo:400:kworker.0 00000100:00100000:1.0:1788851209.234321:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788851209.234343:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851209.234392:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712256 00000100:00100000:3.0:1788851209.234400:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712256 00000100:00100000:0.0:1788851209.234428:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712128 00000100:00100000:0.0:1788851209.234434:0:15077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712128 00000100:00100000:3.0:1788851209.234451:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788851209.234461:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:3310:x1875746019712256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851209.234485:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788851209.234495:0:15077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019712128:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851209.234511:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:3310:x1875746019712256:12345-0@lo:400:kworker.0 Request processed in 51us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851209.234518:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00002000:00000024:0.0:1788851209.234526:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788851209.234575:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851209.234588:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712512 00000100:00100000:3.0:1788851209.234592:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712512 00000100:00100000:0.0:1788851209.234594:0:15077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019712128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851209.234605:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788851209.234626:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851209.234635:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019712512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851209.234655:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf040000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019712128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851209.234682:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875746019712512:12345-0@lo:400:kworker.0 Request processed in 49us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851209.234690:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788851209.234701:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1875746019712512:0@lo:400:kworker.0 00000100:00100000:3.0:1788851209.234743:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712768 00000100:00100000:0.0:1788851209.234744:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712640 00000100:00100000:3.0:1788851209.234749:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712768 00000100:00100000:0.0:1788851209.234751:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712640 00000100:00100000:0.0:1788851209.234816:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788851209.234825:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019712640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851209.234871:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875746019712640:12345-0@lo:400:kworker.0 Request processed in 48us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851209.234878:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788851209.234889:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788851209.234895:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019712768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851209.234920:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875746019712768:12345-0@lo:400:kworker.0 Request processed in 25us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851209.234926:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788851209.234955:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875746019712640:0@lo:400:kworker.0 00000100:00100000:1.0:1788851209.234972:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b8bcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019712384:0@lo:400:kworker.0 00000100:00100000:1.0:1788851209.235002:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851209.235029:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019712896:0@lo:400:kworker.0 00000100:00100000:1.0:1788851209.235049:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851209.235090:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712384 00000100:00100000:2.0:1788851209.235095:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712384 00000100:00100000:2.0:1788851209.235134:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788851209.235146:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019712384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851209.235184:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019712384:12345-0@lo:400:kworker.0 Request processed in 43us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851209.235191:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788851209.246671:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3310:1875746019712256:0@lo:400:kworker.0 00000100:00100000:1.0:1788851209.246698:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1875746019712768:0@lo:400:kworker.0 00000100:00100000:1.0:1788851209.246744:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b8bcf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019712384:0@lo:400:kworker.0 00000100:00100000:3.0:1788851209.249184:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019712896 00000100:00100000:3.0:1788851209.249200:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019712896 00000100:00100000:3.0:1788851209.249273:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788851209.249285:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019712896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851209.249403:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875746019712896:12345-0@lo:400:kworker.0 Request processed in 121us (14353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851209.249411:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788851209.249443:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788851209.249448:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851209.249724:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1875746019712896:0@lo:400:kworker.0 00010000:00010000:2.0:1788851209.753463:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788851209.807955:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ee5876d3-dac7-4454-b807-f34f3453286e 00000001:00100000:2.0:1788851209.807972:0:5883:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a20f2a44-3f34-4fab-952c-679d966a5b8b 00000001:00100000:1.0:1788851209.810275:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ee5876d3-dac7-4454-b807-f34f3453286e 00000001:00100000:1.0:1788851209.810288:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a20f2a44-3f34-4fab-952c-679d966a5b8b 00000001:02000400:0.0:1788851210.461174:0:16356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788851210.778940:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851211.794270:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851212.306611:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788851212.306639:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019713024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788851212.306723:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851212.306874:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019713024 00000100:00100000:2.0:1788851212.306885:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019713024 00000100:00100000:2.0:1788851212.306961:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788851212.306987:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019713024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788851212.307032:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788851212.307086:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019713024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851212.307094:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788851212.307186:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851212.307404:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019713024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788851212.801480:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851212.801530:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851212.801564:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851212.801588:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851212.801624:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851212.801640:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851212.801662:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851212.801690:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000845568 00000100:00100000:0.0:1788851212.801699:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000845568 00000100:00100000:0.0:1788851212.801747:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 106 00000100:00100000:0.0:1788851212.801756:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+13:2351:x1875746000845568:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851212.801875:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+13:2351:x1875746000845568:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 119us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851212.801883:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 106 00000100:00100000:0.0:1788851212.801917:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000845952 00000100:00100000:0.0:1788851212.801920:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000845952 00000100:00100000:0.0:1788851212.801951:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000846208 00000100:00100000:0.0:1788851212.801954:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000846208 00000100:00100000:0.0:1788851212.801968:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000845824 00000100:00100000:0.0:1788851212.801971:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000845824 00000100:00100000:0.0:1788851212.801982:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000846336 00000100:00100000:0.0:1788851212.801984:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000846336 00000100:00100000:0.0:1788851212.802000:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:0.0:1788851212.802007:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+5:2351:x1875746000845952:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851212.802034:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+5:2351:x1875746000845952:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851212.802040:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:0.0:1788851212.802051:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:0.0:1788851212.802057:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee5876d3-dac7-4454-b807-f34f3453286e+5:2351:x1875746000846208:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851212.802086:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee5876d3-dac7-4454-b807-f34f3453286e+5:2351:x1875746000846208:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 30us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851212.802092:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:0.0:1788851212.802104:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:0.0:1788851212.802109:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+5:2351:x1875746000845824:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851212.802130:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+5:2351:x1875746000845824:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 21us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851212.802136:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:0.0:1788851212.802146:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:0.0:1788851212.802152:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee5876d3-dac7-4454-b807-f34f3453286e+5:2351:x1875746000846336:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851212.802170:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ee5876d3-dac7-4454-b807-f34f3453286e+5:2351:x1875746000846336:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 19us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851212.802176:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:0.0:1788851212.802192:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000845696 00000100:00100000:0.0:1788851212.802195:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000845696 00000100:00100000:0.0:1788851212.802219:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000846080 00000100:00100000:0.0:1788851212.802221:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000846080 00000100:00100000:0.0:1788851212.802237:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:0.0:1788851212.802242:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:2351:x1875746000845696:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851212.802267:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:2351:x1875746000845696:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 25us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851212.802273:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:0.0:1788851212.802283:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:0.0:1788851212.802289:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee5876d3-dac7-4454-b807-f34f3453286e+6:2351:x1875746000846080:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:0.0:1788851212.802313:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee5876d3-dac7-4454-b807-f34f3453286e+6:2351:x1875746000846080:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 25us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851212.802319:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00080000:0.0:1788851212.802472:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788851212.802477:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788851212.802480:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788851212.818036:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788851213.699384:0:16504:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc7fd0ca20 20000000:00000080:0.0:1788851213.699467:0:16504:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8a9a83414800 uarg=0000000000000000 20000000:01000000:0.0:1788851213.699505:0:16504:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788851213.699511:0:16504:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788851213.699515:0:16504:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788851213.701222:0:16505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788851213.701477:0:16504:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788851213.710110:0:16504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788851213.710145:0:16504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8a9a83030400/0x7ad3e1a879577f7d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.710165:0:16504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b814a4400/0x7ad3e1a879577c74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577c6d expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.710174:0:16504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577cc1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577cba expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.710179:0:16504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b90546a00/0x7ad3e1a879577dfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577df5 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.710189:0:16504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577f1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee9d expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.710195:0:16504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8a9a83031e00/0x7ad3e1a879577f53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeeff expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.710222:0:16504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8a9a83030400/0x7ad3e1a879577f7d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.710336:0:16504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9a83031e00/0x7ad3e1a879577f53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeeff expref: 12 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.710353:0:16504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9a83031e00/0x7ad3e1a879577f53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeeff expref: 12 pid: 14382 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851213.710368:0:16504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a58a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16504:1875746019713152:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788851213.710598:0:16504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577f1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee9d expref: 12 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.710608:0:16504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577f1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee9d expref: 12 pid: 14380 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851213.710617:0:16504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a58380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16504:1875746019713280:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788851213.710647:0:16504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b90546a00/0x7ad3e1a879577dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879577df5 expref: 18 pid: 14382 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.710656:0:16504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9b90546a00/0x7ad3e1a879577dfc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879577df5 expref: 18 pid: 14382 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851213.710665:0:16504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a59500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16504:1875746019713408:0@lo:104: 00000100:00100000:0.0:1788851213.710698:0:16504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788851213.710740:0:16504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577cc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879577cba expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.710758:0:16504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577cc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879577cba expref: 18 pid: 14380 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851213.710767:0:16504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16504:1875746019713536:0@lo:104: 00000100:00100000:0.0:1788851213.710827:0:16504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788851213.710851:0:16504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8a9b814a4400/0x7ad3e1a879577c74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7ad3e1a879577c6d expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.710859:0:16504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8a9b814a4400/0x7ad3e1a879577c74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7ad3e1a879577c6d expref: 18 pid: 14380 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851213.710867:0:16504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bc1a59880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16504:1875746019713664:0@lo:104: 00000100:00100000:0.0:1788851213.710890:0:16504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851213.710898:0:16504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b91a05180 going to sleep for 11 seconds 00000100:00100000:3.0:1788851213.713003:0:14371:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788851213.713029:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019713408 00000100:00100000:3.0:1788851213.713036:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019713408 00000100:00100000:3.0:1788851213.713070:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019713536 00000100:00100000:3.0:1788851213.713072:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019713536 00000100:00100000:3.0:1788851213.713080:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019713664 00000100:00100000:3.0:1788851213.713083:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019713664 00000100:00100000:3.0:1788851213.713095:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788851213.713103:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+5:16504:x1875746019713408:12345-0@lo:104: 00010000:00010000:3.0:1788851213.713119:0:14371:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9baef58200/0x7ad3e1a879577df5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879577dfc expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.713201:0:14371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788851213.713207:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+5:16504:x1875746019713408:12345-0@lo:104: Request processed in 105us (2509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851213.713213:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788851213.713230:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851213.713236:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+4:16504:x1875746019713536:12345-0@lo:104: 00000100:00100000:0.0:1788851213.713632:0:16504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a59500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16504:1875746019713408:0@lo:104: 00010000:00010000:3.0:1788851213.713705:0:14371:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879577cba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879577cc1 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.713749:0:14371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788851213.713764:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+4:16504:x1875746019713536:12345-0@lo:104: Request processed in 528us (2937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851213.713770:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788851213.713802:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788851213.713893:0:16504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a58700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16504:1875746019713536:0@lo:104: 00000100:00100000:3.0:1788851213.713975:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8da64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+3:16504:x1875746019713664:12345-0@lo:104: 00010000:00010000:3.0:1788851213.713986:0:14371:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879577c6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879577c74 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.714036:0:14371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788851213.714041:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8da64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+3:16504:x1875746019713664:12345-0@lo:104: Request processed in 234us (3150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851213.714047:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788851213.714083:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788851213.714088:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9baef58200/0x7ad3e1a879577df5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879577dfc expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.714096:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58200 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:3.0:1788851213.714100:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9baef58200/0x7ad3e1a879577df5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879577dfc expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.714109:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9baef58200/0x7ad3e1a879577df5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879577dfc expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788851213.714116:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9baef58200/0x7ad3e1a879577df5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879577dfc expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851213.714122:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788851213.714156:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9baef58200/0x7ad3e1a879577df5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577dfc expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.714172:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788851213.714201:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9baef58200/0x7ad3e1a879577df5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577dfc expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.714208:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9baef58200/0x7ad3e1a879577df5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577dfc expref: -99 pid: 15787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.714221:0:14377:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788851213.714224:0:14377:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879577cba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879577cc1 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.714229:0:14377:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b814a4000 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:3.0:1788851213.714232:0:14377:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879577cba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879577cc1 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.714239:0:14377:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879577cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879577cc1 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.714335:0:16010:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851213.714341:0:16010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879577c6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7ad3e1a879577c74 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.714347:0:16010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b90547600 already unused, calling callback (ffffffffc1ccbc20) 10000000:00010000:1.0:1788851213.714351:0:16010:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879577c6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7ad3e1a879577c74 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.714358:0:16010:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879577c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7ad3e1a879577c74 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788851213.714364:0:16010:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879577c6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879577c74 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851213.714369:0:16010:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788851213.714386:0:16010:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879577c6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577c74 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.714403:0:16010:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788851213.714420:0:16010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879577c6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577c74 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.714427:0:16010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b90547600/0x7ad3e1a879577c6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577c74 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.714437:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851213.714439:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788851213.714441:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851213.714454:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3310:1875746019713920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851213.714498:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851213.714550:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019713920 00000100:00100000:1.0:1788851213.714555:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019713920 00010000:00010000:1.0:1788851213.714586:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b814a4400/0x7ad3e1a879577c74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879577c6d expref: 19 pid: 14380 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851213.714607:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788851213.714614:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:3310:x1875746019713920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788851213.714623:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851213.714629:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b814a4400/0x7ad3e1a879577c74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879577c6d expref: 19 pid: 14380 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.714638:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b814a4400/0x7ad3e1a879577c74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879577c6d expref: 19 pid: 14380 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.714653:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851213.714676:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:3310:x1875746019713920:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851213.714682:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788851213.714706:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3310:1875746019713920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851213.714991:0:16504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b814a4400/0x7ad3e1a879577c74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879577c6d expref: 18 pid: 14380 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851213.715003:0:16504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a59880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16504:1875746019713664:0@lo:104: 10000000:00010000:3.0:1788851213.715121:0:14377:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879577cba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7ad3e1a879577cc1 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788851213.715127:0:14377:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788851213.715142:0:14377:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879577cba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577cc1 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.715147:0:14377:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788851213.715185:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafc91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3311:1875746019714048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851213.715212:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851213.715280:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714048 00000100:00100000:0.0:1788851213.715285:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714048 00010000:00010000:0.0:1788851213.715302:0:14374:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577cc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879577cba expref: 18 pid: 14380 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851213.715323:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788851213.715330:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:3311:x1875746019714048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851213.715349:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851213.715353:0:14374:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577cc1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879577cba expref: 18 pid: 14380 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.715362:0:14374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577cc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879577cba expref: 18 pid: 14380 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.715374:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b90546400/0x7ad3e1a879577cc1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879577cba expref: 18 pid: 14380 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.715383:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851213.715451:0:14377:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879577cba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577cc1 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.715459:0:14377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.106@tcp lock: ffff8a9b814a4000/0x7ad3e1a879577cba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7ad3e1a879577cc1 expref: -99 pid: 15071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.715479:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851213.715481:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851213.715483:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788851213.715489:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851213.715502:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788851213.715511:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafc92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3308:1875746019713792:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788851213.715538:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851213.716274:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:3311:x1875746019714048:12345-0@lo:103:ldlm_bl.0 Request processed in 941us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851213.716282:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788851213.716299:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019713792 00000100:00100000:0.0:1788851213.716303:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019713792 00010000:00010000:0.0:1788851213.716318:0:14374:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b90546a00/0x7ad3e1a879577dfc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879577df5 expref: 17 pid: 14382 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851213.716331:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788851213.716336:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:3308:x1875746019713792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788851213.716344:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851213.716348:0:14374:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b90546a00/0x7ad3e1a879577dfc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7ad3e1a879577df5 expref: 17 pid: 14382 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.716356:0:14374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b90546a00/0x7ad3e1a879577dfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7ad3e1a879577df5 expref: 17 pid: 14382 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.716368:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b90546a00/0x7ad3e1a879577dfc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7ad3e1a879577df5 expref: 17 pid: 14382 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851213.716661:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851213.716700:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:3308:x1875746019713792:12345-0@lo:103:ldlm_bl.0 Request processed in 364us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851213.716707:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788851213.716812:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafc92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3308:1875746019713792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788851213.717136:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafc91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3311:1875746019714048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788851213.719750:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851213.719988:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000846464 00000100:00100000:2.0:1788851213.719996:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000846464 00010000:00010000:2.0:1788851213.720028:0:14374:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9a83031e00/0x7ad3e1a879577f53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeeff expref: 13 pid: 14382 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851213.720062:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:2.0:1788851213.720070:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9650a6c-0a31-41c0-9a66-788e070d6102+13:2354:x1875746000846464:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851213.720083:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851213.720088:0:14374:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9a83031e00/0x7ad3e1a879577f53 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeeff expref: 13 pid: 14382 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851213.720100:0:14374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9a83031e00/0x7ad3e1a879577f53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeeff expref: 13 pid: 14382 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851213.720132:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851213.720183:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a9650a6c-0a31-41c0-9a66-788e070d6102+13:2354:x1875746000846464:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 113us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851213.720191:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:2.0:1788851213.721521:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851213.721622:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000846592 00000100:00100000:1.0:1788851213.721629:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000846592 00010000:00010000:1.0:1788851213.721656:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577f1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee9d expref: 13 pid: 14380 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851213.721864:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:1.0:1788851213.721876:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb4169180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9650a6c-0a31-41c0-9a66-788e070d6102+13:2353:x1875746000846592:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851213.721889:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851213.721894:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577f1b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee9d expref: 13 pid: 14380 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.721905:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577f1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee9d expref: 13 pid: 14380 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.721990:0:16504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9a83031e00/0x7ad3e1a879577f53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeeff expref: 13 pid: 14382 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851213.722009:0:16504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a58a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16504:1875746019713152:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851213.722020:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8a9a83030400/0x7ad3e1a879577f7d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.722028:0:16504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9b90547200/0x7ad3e1a879577f1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfee9d expref: 12 pid: 14380 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.722033:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9a83030400/0x7ad3e1a879577f7d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.722050:0:14375:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9a83030400/0x7ad3e1a879577f7d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.722057:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8a9a83030400/0x7ad3e1a879577f7d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.722065:0:14375:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8a9a83030400/0x7ad3e1a879577f7d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.722072:0:14375:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8a9a83030400/0x7ad3e1a879577f7d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.722078:0:14375:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9a83030400 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851213.722083:0:14375:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8a9a83030400/0x7ad3e1a879577f7d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.722097:0:14375:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8a9a83030400/0x7ad3e1a879577f7d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851213.722347:0:16504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bc1a58380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16504:1875746019713280:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851213.722567:0:16504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8a9a83030400/0x7ad3e1a879577f7d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.722587:0:16504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8a9a83030400/0x7ad3e1a879577f7d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851213.722594:0:16504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8a9a83030400/0x7ad3e1a879577f7d lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.722677:0:14375:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8a9a83030400/0x7ad3e1a879577f7d lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.722687:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8a9a83030400/0x7ad3e1a879577f7d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851213.722702:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851213.722762:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb4169180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a9650a6c-0a31-41c0-9a66-788e070d6102+11:2353:x1875746000846592:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 887us (1246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851213.722771:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00010000:00010000:2.0:1788851213.843056:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788851214.291284:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788851214.354757:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafc93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019714304:0@lo:400:kworker.0 00000100:00100000:3.0:1788851214.354902:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851214.354955:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafc91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019714432:0@lo:400:kworker.0 00000100:00100000:3.0:1788851214.354990:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafc90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019714816:0@lo:400:kworker.0 00000100:00100000:2.0:1788851214.355044:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851214.355103:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb416bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019714944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788851214.355807:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafc92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3308:1875746019714176:0@lo:400:kworker.0 00000100:00100000:2.0:1788851214.356613:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851214.356680:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788851214.356690:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafc90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019714560:0@lo:400:kworker.0 00000100:00100000:2.0:1788851214.356757:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851214.356848:0:16008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714304 00000100:00100000:2.0:1788851214.356858:0:16008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714304 00000100:00100000:2.0:1788851214.356930:0:16008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714432 00000100:00100000:2.0:1788851214.356935:0:16008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714432 00000100:00100000:1.0:1788851214.356957:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788851214.356989:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019714304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788851214.357107:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019714304:12345-0@lo:400:kworker.0 Request processed in 129us (2205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851214.357258:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851214.357296:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafc91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019714688:0@lo:400:kworker.0 00000100:00100000:0.0:1788851214.357322:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851214.357358:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714560 00000100:00100000:0.0:1788851214.357362:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714560 00000100:00100000:0.0:1788851214.357392:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714688 00000100:00100000:0.0:1788851214.357395:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714688 00000100:00100000:0.0:1788851214.357419:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788851214.357427:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019714560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851214.357482:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875746019714560:12345-0@lo:400:kworker.0 Request processed in 55us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851214.357489:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788851214.357505:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788851214.357511:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019714688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851214.357542:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019714688:12345-0@lo:400:kworker.0 Request processed in 32us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851214.357548:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788851214.357598:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafc91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019714688:0@lo:400:kworker.0 00000100:00100000:3.0:1788851214.358027:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851214.358077:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafc93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019714304:0@lo:400:kworker.0 00000100:00100000:3.0:1788851214.358110:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714176 00000100:00100000:3.0:1788851214.358114:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714176 00000100:00100000:3.0:1788851214.358146:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788851214.358153:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:3308:x1875746019714176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851214.358198:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:3308:x1875746019714176:12345-0@lo:400:kworker.0 Request processed in 46us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851214.358206:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788851214.358239:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714816 00000100:00100000:3.0:1788851214.358243:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714816 00000100:00100000:3.0:1788851214.358260:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788851214.358266:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019714816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851214.358297:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019714816:12345-0@lo:400:kworker.0 Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851214.358303:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788851214.359820:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafc92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3308:1875746019714176:0@lo:400:kworker.0 00000100:00100000:3.0:1788851214.359859:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafc90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019714816:0@lo:400:kworker.0 00000100:00100000:2.0:1788851214.360254:0:16008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851214.360269:0:16008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019714432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788851214.360342:0:16008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019714432:12345-0@lo:400:kworker.0 Request processed in 78us (5298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851214.360349:0:16008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851214.360378:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019714944 00000100:00100000:2.0:1788851214.360384:0:15077:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019714944 00000100:00100000:2.0:1788851214.360418:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788851214.360425:0:15077:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019714944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788851214.360454:0:15077:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788851214.360495:0:15077:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019714944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (3887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851214.360501:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788851214.360524:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788851214.360531:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788851214.360533:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788851214.360576:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafc90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875746019714560:0@lo:400:kworker.0 00000100:00100000:2.0:1788851214.360589:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafc91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019714432:0@lo:400:kworker.0 00000100:00100000:2.0:1788851214.360604:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb416bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019714944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788851214.361975:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788851214.872837:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788851214.986688:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851214.986876:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000846720 00000100:00100000:3.0:1788851214.986889:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000846720 00000100:00100000:3.0:1788851214.986966:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 108 00000100:00100000:3.0:1788851214.986983:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+11:13785:x1875746000846720:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851214.987023:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851214.987050:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b8168e400/0x7ad3e1a879577f84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef30 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851214.987089:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b8168e400/0x7ad3e1a879577f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef30 expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851214.987103:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b8168e400/0x7ad3e1a879577f84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef30 expref: 12 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851214.987113:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168e400, rc 0) 00000100:00100000:3.0:1788851214.987192:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+12:13785:x1875746000846720:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 212us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851214.987201:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 108 00000100:00100000:3.0:1788851214.993882:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851214.993930:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000846848 00000100:00100000:3.0:1788851214.993944:0:14382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000846848 00000100:00100000:3.0:1788851214.994023:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 109 00000100:00100000:3.0:1788851214.994040:0:14382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+12:13785:x1875746000846848:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851214.994462:0:14382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9650a6c-0a31-41c0-9a66-788e070d6102+12:13785:x1875746000846848:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 424us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851214.994474:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 109 00000100:00100000:2.0:1788851215.012207:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851215.012399:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000846976 00000100:00100000:3.0:1788851215.012415:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000846976 00000100:00100000:3.0:1788851215.012493:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 110 00000100:00100000:3.0:1788851215.012506:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+12:13785:x1875746000846976:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851215.015708:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+12:13785:x1875746000846976:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 Request processed in 3191us (3506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.015738:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 110 00000100:00100000:1.0:1788851215.025110:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851215.027433:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000847104 00000100:00100000:3.0:1788851215.027525:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000847104 00000100:00100000:3.0:1788851215.027767:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 111 00000100:00100000:3.0:1788851215.027779:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+12:13785:x1875746000847104:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851215.027817:0:14383:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851215.027847:0:14383:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577f8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef37 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.027879:0:14383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577f8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef37 expref: 13 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.027891:0:14383:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b8168ee00/0x7ad3e1a879577f8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef37 expref: 13 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.027900:0:14383:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168ee00, rc 0) 00000100:00100000:3.0:1788851215.027972:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+13:13785:x1875746000847104:12345-192.168.204.6@tcp:101:ll_cfg_requeue.0 Request processed in 195us (2874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.027979:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 111 00000100:00100000:0.0:1788851215.039615:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851215.039732:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000847232 00000100:00100000:3.0:1788851215.039744:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000847232 00000100:00100000:3.0:1788851215.040298:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 112 00000100:00100000:3.0:1788851215.040392:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+13:13785:x1875746000847232:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851215.041126:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9650a6c-0a31-41c0-9a66-788e070d6102+13:13785:x1875746000847232:12345-192.168.204.6@tcp:501:ll_cfg_requeue.0 Request processed in 736us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.041136:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 112 00000100:00100000:1.0:1788851215.047163:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851215.047225:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000847360 00000100:00100000:2.0:1788851215.047250:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000847360 00000100:00100000:2.0:1788851215.047313:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 113 00000100:00100000:2.0:1788851215.047335:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+13:13785:x1875746000847360:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851215.047899:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+13:13785:x1875746000847360:12345-192.168.204.6@tcp:503:ll_cfg_requeue.0 Request processed in 564us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851215.047908:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 113 10000000:01000000:2.0:1788851215.443480:0:14385:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788851215.443488:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9bb45fa000 from 10 10000000:01000000:2.0:1788851215.443492:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788851215.443535:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879577f92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.443557:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879577f92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.443569:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879577f92 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851215.443594:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788851215.443655:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851215.443701:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98d1b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.443751:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715072 00000100:00100000:3.0:1788851215.443759:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715072 00000100:00100000:3.0:1788851215.443868:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788851215.443876:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+16:14385:x1875746019715072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851215.443889:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851215.443903:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b8168f000/0x7ad3e1a879577f99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577f92 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.443925:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b8168f000/0x7ad3e1a879577f99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577f92 expref: 17 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.443935:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b8168f000/0x7ad3e1a879577f99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577f92 expref: 17 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.443943:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f000, rc 0) 00000100:00100000:3.0:1788851215.443981:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:14385:x1875746019715072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.443988:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788851215.444078:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851215.444094:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879577f92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577f99 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.444103:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879577f92 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577f99 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851215.444166:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851215.444190:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851215.444212:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c18000 going to sleep for 11 seconds 00000100:00100000:2.0:1788851215.444275:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715200 00000100:00100000:2.0:1788851215.444279:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715200 00000100:00100000:2.0:1788851215.444309:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788851215.444315:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:14385:x1875746019715200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851215.444535:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:14385:x1875746019715200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851215.444553:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788851215.448156:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851215.448260:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851215.448338:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851215.448373:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c18000 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.448425:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715328 00000100:00100000:3.0:1788851215.448433:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715328 00000100:00100000:3.0:1788851215.448479:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788851215.448488:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:14385:x1875746019715328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851215.448688:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:14385:x1875746019715328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.448696:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788851215.448881:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788851215.449611:0:16584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788851215.449758:0:14385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788851215.449815:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788851215.449825:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879577f92 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577f99 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.449837:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b98af7e00/0x7ad3e1a879577f92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577f99 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788851215.449846:0:14385:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788851215.449849:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9bb45ff800 from 10 10000000:01000000:1.0:1788851215.449851:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788851215.449882:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9baef59c00/0x7ad3e1a879577fa0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.449890:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9baef59c00/0x7ad3e1a879577fa0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.449899:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9baef59c00/0x7ad3e1a879577fa0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851215.449927:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788851215.449972:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851215.450001:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c18000 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.450091:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715456 00000100:00100000:3.0:1788851215.450096:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715456 00000100:00100000:3.0:1788851215.450141:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788851215.450149:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+17:14385:x1875746019715456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851215.450160:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851215.450171:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b8168e600/0x7ad3e1a879577fa7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577fa0 expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.450193:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b8168e600/0x7ad3e1a879577fa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577fa0 expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.450203:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b8168e600/0x7ad3e1a879577fa7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577fa0 expref: 18 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.450210:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168e600, rc 0) 00000100:00100000:3.0:1788851215.450251:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:14385:x1875746019715456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.450258:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788851215.450347:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788851215.450360:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9baef59c00/0x7ad3e1a879577fa0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577fa7 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.450369:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9baef59c00/0x7ad3e1a879577fa0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577fa7 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851215.450412:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851215.450438:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851215.450460:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c18000 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.450499:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715584 00000100:00100000:3.0:1788851215.450504:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715584 00000100:00100000:3.0:1788851215.450572:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788851215.450580:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:14385:x1875746019715584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851215.450836:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:14385:x1875746019715584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.450843:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788851215.450908:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788851215.450932:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788851215.450968:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851215.451165:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c18000 going to sleep for 11 seconds 00000100:00100000:2.0:1788851215.451194:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715712 00000100:00100000:2.0:1788851215.451198:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715712 00000100:00100000:2.0:1788851215.451221:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788851215.451228:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb44a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:14385:x1875746019715712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851215.451378:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb44a2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:14385:x1875746019715712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851215.451385:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788851215.451454:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d74700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788851215.452221:0:16585:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788851215.452356:0:14385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788851215.452374:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788851215.452381:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9baef59c00/0x7ad3e1a879577fa0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577fa7 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.452391:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9baef59c00/0x7ad3e1a879577fa0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577fa7 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788851215.452402:0:14385:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788851215.452404:0:14385:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8a9b929b7800 from 10 10000000:01000000:2.0:1788851215.452407:0:14385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788851215.452433:0:14385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6a00/0x7ad3e1a879577fae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.452440:0:14385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6a00/0x7ad3e1a879577fae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.452449:0:14385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6a00/0x7ad3e1a879577fae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851215.452467:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788851215.452507:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851215.452585:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b90422480 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.452691:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715840 00000100:00100000:3.0:1788851215.452698:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715840 00000100:00100000:3.0:1788851215.452731:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788851215.452738:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+18:14385:x1875746019715840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788851215.452747:0:14380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851215.452765:0:14380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8a9b8168fa00/0x7ad3e1a879577fb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7ad3e1a879577fae expref: -99 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.452810:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8a9b8168fa00/0x7ad3e1a879577fb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7ad3e1a879577fae expref: 19 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.452820:0:14380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8a9b8168fa00/0x7ad3e1a879577fb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7ad3e1a879577fae expref: 19 pid: 14380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851215.452828:0:14380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168fa00, rc 0) 00000100:00100000:3.0:1788851215.452862:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:14385:x1875746019715840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.452868:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788851215.453064:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788851215.453080:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6a00/0x7ad3e1a879577fae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577fb5 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851215.453088:0:14385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6a00/0x7ad3e1a879577fae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7ad3e1a879577fb5 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851215.453138:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851215.453167:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851215.453189:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b90422480 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.453229:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019715968 00000100:00100000:3.0:1788851215.453234:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019715968 00000100:00100000:3.0:1788851215.453251:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788851215.453257:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:14385:x1875746019715968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788851215.453518:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:14385:x1875746019715968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 260us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.453526:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788851215.454135:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019715968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788851215.454175:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019716096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788851215.454220:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851215.454283:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b90422480 going to sleep for 11 seconds 00000100:00100000:3.0:1788851215.454326:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019716096 00000100:00100000:3.0:1788851215.454332:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019716096 00000100:00100000:3.0:1788851215.454399:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788851215.454408:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:14385:x1875746019716096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788851215.454578:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:14385:x1875746019716096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851215.454586:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788851215.454658:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:88a8a83d-2380-4e6d-b8f7-1327e5aed605:14385:1875746019716096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788851215.455467:0:16586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788851215.455637:0:14385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788851215.455656:0:14385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.106@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788851215.455666:0:14385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6a00/0x7ad3e1a879577fae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577fb5 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.455691:0:14385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.106@tcp lock: ffff8a9b98af6a00/0x7ad3e1a879577fae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7ad3e1a879577fb5 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851215.890507:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788851216.914099:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851217.132621:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851217.132817:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000847488 00000100:00100000:3.0:1788851217.132840:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000847488 00000100:00080000:2.0:1788851217.132896:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851217.132919:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:3.0:1788851217.132931:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:14443:x1875746000847488:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851217.132951:0:15800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851217.132980:0:15800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879577fbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef3e expref: -99 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.133976:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879577fc3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.133994:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879577fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134017:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879577fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134034:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879577fca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134041:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879577fca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134051:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879577fca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134454:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ec00/0x7ad3e1a879577fd1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134463:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ec00/0x7ad3e1a879577fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134470:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ec00/0x7ad3e1a879577fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851217.134502:0:15800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788851217.134515:0:15800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788851217.134552:0:15800:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ec00/0x7ad3e1a879577fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134563:0:15800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879577fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134570:0:15800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879577fc3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134577:0:15800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879577fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134583:0:15800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168e000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851217.134592:0:15800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879577fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134600:0:15800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879577fc3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134612:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b990e2b00) 00010000:00010000:3.0:1788851217.134615:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851217.134620:0:15800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879577fc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134626:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879577fc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134640:0:15800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879577fca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134656:0:15800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879577fca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134662:0:15800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879577fca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134667:0:15800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ea00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851217.134670:0:15800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879577fca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134677:0:15800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879577fca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134685:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8a9b84f2f000) 00010000:00010000:3.0:1788851217.134687:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851217.134690:0:15800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879577fca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134695:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879577fca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134730:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879577fbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef3e expref: 8 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134745:0:15800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ec00/0x7ad3e1a879577fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef3e expref: 7 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.134753:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a9b84f2f300) 00010000:00010000:3.0:1788851217.134755:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788851217.134764:0:15800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168ec00, rc 0) 00000100:00100000:3.0:1788851217.134880:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+7:14443:x1875746000847488:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 1950us (2267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851217.134890:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:0.0:1788851217.138720:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851217.138833:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000847744 00000100:00100000:1.0:1788851217.138854:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000847744 00000100:00100000:1.0:1788851217.138921:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:1.0:1788851217.138934:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+7:14443:x1875746000847744:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851217.138956:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851217.138988:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577fd8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef45 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139062:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879577fdf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139077:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879577fdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139091:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879577fdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139169:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577fe6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139176:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139183:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139519:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577fed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139529:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577fed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139536:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577fed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851217.139546:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788851217.139740:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879577fdf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139748:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879577fdf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139754:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879577fdf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139760:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851217.139764:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879577fdf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139771:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879577fdf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139824:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8a9b84f2f300) 00010000:00010000:1.0:1788851217.139828:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851217.139833:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879577fdf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139850:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879577fdf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139864:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139870:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577fe6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139875:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139880:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851217.139883:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139888:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577fe6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139896:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8a9b9199aa00) 00010000:00010000:1.0:1788851217.139898:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851217.139901:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577fe6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.139906:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879577fe6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.140346:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577fd8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef45 expref: 10 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.140376:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59a00/0x7ad3e1a879577fed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef45 expref: 9 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.140383:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a9b9199ac00) 00010000:00010000:1.0:1788851217.140386:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851217.140388:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59a00, rc 0) 00000100:00100000:1.0:1788851217.140446:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+9:14443:x1875746000847744:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 1515us (1739us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788851217.140454:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:1.0:1788851217.145207:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851217.145324:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000847872 00000100:00100000:0.0:1788851217.145334:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000847872 00000100:00100000:0.0:1788851217.145389:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:0.0:1788851217.145400:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+9:14443:x1875746000847872:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788851217.145562:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+9:14443:x1875746000847872:12345-192.168.204.6@tcp:59:lhsmtool_posix.0 Request processed in 163us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851217.145570:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:0.0:1788851217.221633:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851217.221868:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000848000 00000100:00100000:1.0:1788851217.221878:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000848000 00000100:00100000:1.0:1788851217.222158:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:1.0:1788851217.222170:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+9:14449:x1875746000848000:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851217.222191:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851217.222211:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577ffb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef4c expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222275:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578002 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222288:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578002 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222298:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578002 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222330:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578009 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222338:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578009 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222345:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578009 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222659:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578002 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222668:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578002 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222675:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578002 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222681:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851217.222686:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578002 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222693:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578002 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222706:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b990e2b00) 00010000:00010000:1.0:1788851217.222709:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851217.222714:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578002 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222719:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578002 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222739:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578009 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222745:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578009 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222751:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578009 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222757:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851217.222760:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578009 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222766:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578009 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222775:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a9b9199aa00) 00010000:00010000:1.0:1788851217.222777:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851217.222823:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578009 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222831:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578009 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222865:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577ffb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef4c expref: 10 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222875:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b990e2b00) 00010000:00010000:1.0:1788851217.222877:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851217.222889:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a879577ffb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef4c expref: 10 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.222899:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58200, rc 0) 00000100:00100000:1.0:1788851217.223248:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+9:14449:x1875746000848000:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1079us (1622us total) trans 0 rc 301/301 00000100:00100000:1.0:1788851217.223256:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:1.0:1788851217.240618:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851217.241328:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000848128 00000100:00100000:0.0:1788851217.241340:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000848128 00000100:00100000:0.0:1788851217.241402:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:0.0:1788851217.241415:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a20f2a44-3f34-4fab-952c-679d966a5b8b+9:14449:x1875746000848128:12345-192.168.204.6@tcp:700:lfs.0 00000100:00100000:0.0:1788851217.241519:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a20f2a44-3f34-4fab-952c-679d966a5b8b+9:14449:x1875746000848128:12345-192.168.204.6@tcp:700:lfs.0 Request processed in 107us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851217.241527:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:0.0:1788851217.249300:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851217.249456:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000848384 00000100:00100000:3.0:1788851217.249468:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000848384 00000100:00100000:3.0:1788851217.249576:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:3.0:1788851217.249586:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+9:14449:x1875746000848384:12345-192.168.204.6@tcp:36:lfs.0 00010000:00010000:3.0:1788851217.249644:0:15800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788851217.249673:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030e00/0x7ad3e1a879577f3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeec7 expref: 9 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.249693:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b990e2b00) 00010000:00010000:3.0:1788851217.249698:0:15800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788851217.249991:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578010 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.250008:0:15800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a879577f76 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef29 expref: 5 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.250017:0:15800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578010 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.250065:0:15800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a879577f76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef29 expref: 5 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.250087:0:15800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a879577f76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef29 expref: 5 pid: 14390 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851217.250115:0:15800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafc90700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15800:1875746019716224:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851217.250200:0:15800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9bb401b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788851217.258937:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851217.259009:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000848512 00000100:00100000:1.0:1788851217.259018:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000848512 00000100:00100000:3.0:1788851217.259036:0:15800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafc90700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15800:1875746019716224:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851217.259061:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a879577f76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef29 expref: 6 pid: 14390 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851217.259094:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00010000:00010000:3.0:1788851217.259103:0:15800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578010 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851217.259103:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee5876d3-dac7-4454-b807-f34f3453286e+6:2353:x1875746000848512:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851217.259116:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851217.259124:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a879577f76 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef29 expref: 6 pid: 14390 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.259136:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a879577f76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef29 expref: 6 pid: 14390 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.259156:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a879577f76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef29 expref: 6 pid: 14390 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.259171:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b990e2b00) 00010000:00010000:1.0:1788851217.259176:0:14373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578010 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.259201:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578010 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.259208:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578010 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.259239:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851217.259297:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ee5876d3-dac7-4454-b807-f34f3453286e+5:2353:x1875746000848512:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 194us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851217.259305:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00080000:2.0:1788851217.259446:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788851217.259551:0:15800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578010 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.259559:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578010 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.259585:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578017 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.259594:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578017 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.259601:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578017 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851217.260861:0:15800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788851217.260877:0:15800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578010 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.260886:0:15800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578010 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.260894:0:15800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578010 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.260906:0:15800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851217.260910:0:15800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578010 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.260918:0:15800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578010 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.260933:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9b990e2b00) 00010000:00010000:3.0:1788851217.260936:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851217.260941:0:15800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578010 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.260947:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578010 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851217.260969:0:15800:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000461e883f reply state 00000000af4281a9 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578017 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851217.260979:0:15800:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788851217.261088:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+10:14449:x1875746000848384:12345-192.168.204.6@tcp:36:lfs.0 Request processed in 11501us (11796us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788851217.261096:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 19 00010000:00010000:1.0:1788851217.266547:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578017 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.266566:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578017 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.266574:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578017 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.266581:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ea00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851217.266585:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578017 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.266594:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578017 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.266611:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a9b84f2f000) 00010000:00010000:1.0:1788851217.266614:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851217.266619:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578017 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.266643:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578017 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788851217.362445:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788851217.384942:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851217.386945:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000848640 00000100:00100000:2.0:1788851217.386962:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000848640 00000100:00100000:2.0:1788851217.387047:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:2.0:1788851217.387059:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+9:14457:x1875746000848640:12345-192.168.204.6@tcp:101:lctl.0 00010000:00010000:2.0:1788851217.387106:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851217.387133:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957801e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef53 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.387197:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6800/0x7ad3e1a879578025 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.387212:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6800/0x7ad3e1a879578025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.387225:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6800/0x7ad3e1a879578025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851217.387263:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788851217.387267:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788851217.387304:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6800/0x7ad3e1a879578025 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.387329:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957801e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef53 expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.387349:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6800/0x7ad3e1a879578025 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef53 expref: 10 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.387357:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02700) 00010000:00010000:2.0:1788851217.387359:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851217.387363:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6800, rc 0) 00000100:00100000:2.0:1788851217.387442:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+10:14457:x1875746000848640:12345-192.168.204.6@tcp:101:lctl.0 Request processed in 386us (2511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851217.387458:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:2.0:1788851217.412294:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851217.412387:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000848768 00000100:00100000:0.0:1788851217.412398:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000848768 00000100:00100000:0.0:1788851217.412461:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:0.0:1788851217.412472:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee5876d3-dac7-4454-b807-f34f3453286e+5:14458:x1875746000848768:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1788851217.412492:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851217.412526:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030400/0x7ad3e1a87957802c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef5a expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.412591:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031e00/0x7ad3e1a879578033 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.412619:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031e00/0x7ad3e1a879578033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.412630:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031e00/0x7ad3e1a879578033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851217.412664:0:14389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788851217.412667:0:14389:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788851217.412688:0:14389:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031e00/0x7ad3e1a879578033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.412711:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030400/0x7ad3e1a87957802c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef5a expref: 7 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.412729:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031e00/0x7ad3e1a879578033 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef5a expref: 6 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.412736:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02700) 00010000:00010000:0.0:1788851217.412738:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851217.412742:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9a83031e00, rc 0) 00000100:00100000:0.0:1788851217.412868:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee5876d3-dac7-4454-b807-f34f3453286e+6:14458:x1875746000848768:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 396us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851217.412875:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 21 00000100:00100000:3.0:1788851217.423880:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851217.424056:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000848896 00000100:00100000:2.0:1788851217.424067:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000848896 00000100:00100000:2.0:1788851217.424127:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:2.0:1788851217.424138:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee5876d3-dac7-4454-b807-f34f3453286e+6:14458:x1875746000848896:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1788851217.424157:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851217.424179:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957803a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef61 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424243:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578041 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424257:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578041 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424269:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578041 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424283:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a879578048 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424289:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a879578048 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424296:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a879578048 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424439:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957804f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424494:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957804f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424519:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957804f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851217.424552:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788851217.424557:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788851217.424576:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957804f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424589:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578041 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424595:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578041 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424602:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578041 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424619:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851217.424624:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578041 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424631:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578041 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424644:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02700) 00010000:00010000:2.0:1788851217.424647:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851217.424653:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578041 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424671:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578041 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424685:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a879578048 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424690:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a879578048 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424696:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a879578048 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424700:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851217.424703:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a879578048 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424710:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a879578048 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424719:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a9bbcd02c00) 00010000:00010000:2.0:1788851217.424721:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851217.424724:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a879578048 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424730:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a879578048 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424758:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a87957803a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef61 expref: 8 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424854:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957804f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef61 expref: 7 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.424861:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a9bbcd02000) 00010000:00010000:2.0:1788851217.424863:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851217.424865:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7600, rc 0) 00000100:00100000:2.0:1788851217.424926:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee5876d3-dac7-4454-b807-f34f3453286e+7:14458:x1875746000848896:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 789us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851217.424933:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 22 00000100:00100000:2.0:1788851217.426631:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019716352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851217.426696:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851217.426855:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019716352 00000100:00100000:3.0:1788851217.426863:0:16267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019716352 00000100:00100000:3.0:1788851217.426922:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788851217.426932:0:16267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019716352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788851217.426977:0:16267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788851217.427722:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851217.434328:0:16267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019716352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7376us (7610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851217.434359:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788851217.434685:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019716352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788851217.440363:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851217.444108:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000849152 00000100:00100000:0.0:1788851217.444125:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000849152 00000100:00100000:0.0:1788851217.446537:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:0.0:1788851217.446568:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee5876d3-dac7-4454-b807-f34f3453286e+7:14458:x1875746000849152:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1788851217.446612:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851217.446635:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030c00/0x7ad3e1a879578056 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef68 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851217.446733:0:14389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788851217.446875:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030c00/0x7ad3e1a879578056 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef68 expref: 9 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.446890:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02700) 00010000:00010000:0.0:1788851217.446893:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788851217.446901:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030c00/0x7ad3e1a879578056 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef68 expref: 9 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.446917:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9a83030c00, rc 0) 00000100:00100000:0.0:1788851217.447009:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ee5876d3-dac7-4454-b807-f34f3453286e+8:14458:x1875746000849152:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 457us (6659us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788851217.447017:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 23 00000100:00100000:0.0:1788851217.452210:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851217.452298:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000849408 00000100:00100000:2.0:1788851217.452308:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000849408 00000100:00100000:2.0:1788851217.452365:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 24 00000100:00100000:2.0:1788851217.452374:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee5876d3-dac7-4454-b807-f34f3453286e+8:14458:x1875746000849408:12345-192.168.204.6@tcp:36:lfs.0 00010000:00010000:2.0:1788851217.452441:0:14390:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851217.452478:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a87957804f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef61 expref: 8 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.452497:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a9bbcd02000) 00010000:00010000:2.0:1788851217.452518:0:14390:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851217.452540:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879578064 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.452570:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879578064 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.452582:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879578064 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788851217.453555:0:14390:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf7877ce reply state 00000000ff638e57 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879578064 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851217.453572:0:14390:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788851217.453581:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788851217.453752:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee5876d3-dac7-4454-b807-f34f3453286e+9:14458:x1875746000849408:12345-192.168.204.6@tcp:36:lfs.0 Request processed in 1376us (1551us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788851217.453762:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 24 00010000:00010000:0.0:1788851217.456017:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879578064 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.456033:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879578064 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.456045:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879578064 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.456052:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851217.456056:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879578064 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.456079:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879578064 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.456096:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a9bbcd02c00) 00010000:00010000:0.0:1788851217.456099:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788851217.456104:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879578064 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.456111:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7400/0x7ad3e1a879578064 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851217.459077:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851217.459187:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000849664 00000100:00100000:2.0:1788851217.459268:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000849664 00000100:00100000:2.0:1788851217.459324:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:2.0:1788851217.459335:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee5876d3-dac7-4454-b807-f34f3453286e+8:14458:x1875746000849664:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1788851217.459890:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee5876d3-dac7-4454-b807-f34f3453286e+9:14458:x1875746000849664:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 556us (822us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788851217.459900:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:2.0:1788851217.462383:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851217.463265:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000849920 00000100:00100000:1.0:1788851217.463276:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000849920 00000100:00100000:1.0:1788851217.463335:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:1.0:1788851217.463347:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee5876d3-dac7-4454-b807-f34f3453286e+9:14458:x1875746000849920:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851217.463375:0:15800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851217.463396:0:15800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a87957806b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef6f expref: -99 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.463556:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578072 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.463572:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578072 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.463584:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578072 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.463600:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578079 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.463871:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.463879:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851217.464138:0:15800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788851217.464235:0:15800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578072 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464244:0:15800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578072 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464251:0:15800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578072 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464258:0:15800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851217.464262:0:15800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578072 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464270:0:15800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578072 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464283:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02700) 00010000:00010000:1.0:1788851217.464286:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851217.464291:0:15800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464298:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a879578072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464311:0:15800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578079 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464318:0:15800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578079 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464335:0:15800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578079 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464340:0:15800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851217.464343:0:15800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578079 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464350:0:15800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578079 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464358:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a9b9199aa00) 00010000:00010000:1.0:1788851217.464361:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851217.464364:0:15800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578079 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464369:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578079 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464484:0:15800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a87957806b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef6f expref: 11 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464508:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02700) 00010000:00010000:1.0:1788851217.464511:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788851217.464515:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a87957806b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef6f expref: 11 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.464526:0:15800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58c00, rc 0) 00000100:00100000:1.0:1788851217.464873:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ee5876d3-dac7-4454-b807-f34f3453286e+10:14458:x1875746000849920:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 1528us (2499us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788851217.464894:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 25 00000100:00100000:0.0:1788851217.467316:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851217.467402:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000850048 00000100:00100000:2.0:1788851217.467411:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000850048 00000100:00100000:2.0:1788851217.467581:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 26 00000100:00100000:2.0:1788851217.467593:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee5876d3-dac7-4454-b807-f34f3453286e+10:14458:x1875746000850048:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1788851217.467632:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851217.467667:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578087 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef76 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.467755:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a87957808e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.467768:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a87957808e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.467815:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a87957808e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851217.467842:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788851217.467846:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788851217.467876:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a87957808e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.467906:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578087 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef76 expref: 12 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.467923:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a87957808e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef76 expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.467932:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a9bbcd02000) 00010000:00010000:2.0:1788851217.467934:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788851217.467937:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7a00, rc 0) 00000100:00100000:2.0:1788851217.468012:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ee5876d3-dac7-4454-b807-f34f3453286e+11:14458:x1875746000850048:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 412us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851217.468021:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 26 00000100:00100000:0.0:1788851217.473126:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851217.473237:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000850176 00000100:00100000:3.0:1788851217.473248:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000850176 00000100:00100000:3.0:1788851217.473335:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:3.0:1788851217.473346:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee5876d3-dac7-4454-b807-f34f3453286e+11:14458:x1875746000850176:12345-192.168.204.6@tcp:37:lfs.0 00000100:00100000:3.0:1788851217.480770:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ee5876d3-dac7-4454-b807-f34f3453286e+11:14458:x1875746000850176:12345-192.168.204.6@tcp:37:lfs.0 Request processed in 7415us (7643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851217.480820:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 3 00000100:00100000:0.0:1788851217.488409:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851217.489131:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000850432 00000100:00100000:2.0:1788851217.489155:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000850432 00000100:00100000:2.0:1788851217.489215:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:2.0:1788851217.489226:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee5876d3-dac7-4454-b807-f34f3453286e+11:14458:x1875746000850432:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1788851217.489776:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d4cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ee5876d3-dac7-4454-b807-f34f3453286e+12:14458:x1875746000850432:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 549us (1374us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788851217.489819:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 4 00000100:00100000:0.0:1788851217.536579:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851217.536727:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000850560 00000100:00100000:2.0:1788851217.536737:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000850560 00000100:00100000:2.0:1788851217.536842:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:2.0:1788851217.536854:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+10:14464:x1875746000850560:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:2.0:1788851217.536875:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851217.536896:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef7d expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.536966:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a87957809c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.536981:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a87957809c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.536993:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a87957809c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537008:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a8795780a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537015:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a8795780a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537022:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a8795780a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537131:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795780aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537139:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795780aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537147:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795780aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851217.537174:0:14389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788851217.537177:0:14389:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788851217.537351:0:14389:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795780aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537364:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a87957809c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537370:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a87957809c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537377:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a87957809c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537383:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851217.537387:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a87957809c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537395:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a87957809c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537407:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02700) 00010000:00010000:2.0:1788851217.537417:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851217.537423:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a87957809c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537430:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a87957809c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537445:0:14389:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a8795780a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537451:0:14389:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a8795780a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537456:0:14389:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a8795780a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537461:0:14389:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851217.537464:0:14389:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a8795780a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537469:0:14389:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a8795780a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537477:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8a9bbcd02e00) 00010000:00010000:2.0:1788851217.537480:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851217.537483:0:14389:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a8795780a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537488:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a8795780a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537536:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef7d expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537563:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6000/0x7ad3e1a8795780aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef7d expref: 11 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.537572:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a9bbcd02000) 00010000:00010000:2.0:1788851217.537575:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788851217.537577:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6000, rc 0) 00000100:00100000:2.0:1788851217.537633:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+11:14464:x1875746000850560:12345-192.168.204.6@tcp:101:bash.0 Request processed in 782us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851217.537641:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 27 00000100:00100000:3.0:1788851217.541060:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851217.542819:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000850816 00000100:00100000:1.0:1788851217.542834:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000850816 00000100:00100000:1.0:1788851217.543270:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 28 00000100:00100000:1.0:1788851217.543283:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+11:14464:x1875746000850816:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1788851217.543304:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851217.543326:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795780b1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef84 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.543440:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a8795780b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.543455:0:14388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a87957808e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef76 expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.543464:0:14388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a8795780b8 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.543514:0:14388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a87957808e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef76 expref: 11 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.543530:0:14388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a87957808e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef76 expref: 11 pid: 14390 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851217.543545:0:14388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d76d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14388:1875746019716480:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851217.543633:0:14388:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c18900 going to sleep for 11 seconds 00000100:00100000:1.0:1788851217.551426:0:14388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d76d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14388:1875746019716480:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851217.551484:0:14388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a8795780b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851217.552267:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851217.552520:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000850944 00000100:00100000:1.0:1788851217.552528:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000850944 00010000:00010000:1.0:1788851217.552566:0:14375:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a87957808e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef76 expref: 12 pid: 14390 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851217.552617:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:1.0:1788851217.552627:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee5876d3-dac7-4454-b807-f34f3453286e+12:2353:x1875746000850944:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851217.552643:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851217.552650:0:14375:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a87957808e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef76 expref: 12 pid: 14390 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.552662:0:14375:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a87957808e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef76 expref: 12 pid: 14390 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.552694:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a87957808e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef76 expref: 12 pid: 14390 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.552711:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a9bbcd02000) 00010000:00010000:1.0:1788851217.552717:0:14375:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a8795780b8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.552726:0:14375:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a8795780b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.552735:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a8795780b8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.552771:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851217.552856:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ee5876d3-dac7-4454-b807-f34f3453286e+11:2353:x1875746000850944:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 230us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851217.552864:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 10 00010000:00010000:3.0:1788851217.553687:0:14388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a8795780b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.553700:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a8795780b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.553727:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795780bf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.553739:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795780bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.553748:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795780bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.557154:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a8795780c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.557178:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a8795780c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.557349:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a8795780c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851217.557363:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788851217.557396:0:14388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a8795780b8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.557405:0:14388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a8795780b8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.557412:0:14388:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a8795780b8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.557419:0:14388:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851217.557424:0:14388:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a8795780b8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.557432:0:14388:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a8795780b8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.557445:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a9bbcd02000) 00010000:00010000:3.0:1788851217.557448:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851217.557453:0:14388:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a8795780b8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.557459:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a8795780b8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851217.557475:0:14388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004753d9bd reply state 0000000084f2d09e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795780bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851217.557511:0:14388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788851217.557553:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58c00/0x7ad3e1a8795780b1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef84 expref: 14 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.557569:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a8795780c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef84 expref: 13 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851217.557577:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:3.0:1788851217.557579:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788851217.557582:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168e000, rc 0) 00000100:00100000:3.0:1788851217.557674:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+14:14464:x1875746000850816:12345-192.168.204.6@tcp:101:bash.0 Request processed in 14393us (16623us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788851217.558466:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 28 00010000:00010000:1.0:1788851217.561089:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795780bf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.561107:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795780bf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.561114:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795780bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.561121:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851217.561125:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795780bf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.561133:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795780bf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.561149:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a9b84f2f500) 00010000:00010000:1.0:1788851217.561153:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851217.561157:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795780bf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.561163:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795780bf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851217.575136:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851217.575291:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000851072 00000100:00100000:1.0:1788851217.575302:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000851072 00000100:00100000:1.0:1788851217.575383:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00100000:1.0:1788851217.575393:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+13:14464:x1875746000851072:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1788851217.575423:0:15800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851217.575444:0:15800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795780d4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef8b expref: -99 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.575521:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795780db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.575539:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795780db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.575552:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795780db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851217.575593:0:15800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788851217.575597:0:15800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788851217.575631:0:15800:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795780db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.575641:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795780db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.575669:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a8795780d4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef8b expref: 15 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.575699:0:15800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795780db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef8b expref: 14 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.575707:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:1.0:1788851217.575716:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851217.575720:0:15800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58200, rc 0) 00000100:00100000:1.0:1788851217.575821:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+14:14464:x1875746000851072:12345-192.168.204.6@tcp:101:bash.0 Request processed in 391us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851217.575829:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 29 00000100:00100000:3.0:1788851217.579753:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851217.579837:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000851328 00000100:00100000:0.0:1788851217.579847:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000851328 00000100:00100000:0.0:1788851217.579897:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:0.0:1788851217.579907:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+14:14464:x1875746000851328:12345-192.168.204.6@tcp:35:bash.0 00000100:00100000:0.0:1788851217.580406:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+15:14464:x1875746000851328:12345-192.168.204.6@tcp:35:bash.0 Request processed in 497us (659us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788851217.580414:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 5 00000100:00100000:0.0:1788851217.735846:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851217.735961:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000851584 00000100:00100000:2.0:1788851217.735972:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000851584 00000100:00100000:2.0:1788851217.736038:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 30 00000100:00100000:2.0:1788851217.736051:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+15:14474:x1875746000851584:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1788851217.736081:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851217.736107:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a8795780e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef92 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851217.736202:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788851217.736323:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a8795780e2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef92 expref: 17 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.736338:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02700) 00010000:00010000:2.0:1788851217.736342:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851217.736348:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a8795780e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef92 expref: 17 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.736379:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7000, rc 0) 00000100:00100000:2.0:1788851217.736450:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+16:14474:x1875746000851584:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 401us (613us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788851217.736458:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 30 00000100:00100000:2.0:1788851217.743262:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851217.743351:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000851840 00000100:00100000:3.0:1788851217.743361:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000851840 00000100:00100000:3.0:1788851217.743428:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:3.0:1788851217.743439:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+16:14474:x1875746000851840:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1788851217.744057:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+17:14474:x1875746000851840:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 616us (804us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788851217.744075:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 6 00000100:00100000:0.0:1788851217.810047:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851217.810133:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000852096 00000100:00100000:1.0:1788851217.810144:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000852096 00000100:00100000:1.0:1788851217.810209:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:1.0:1788851217.810220:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+17:14477:x1875746000852096:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:1.0:1788851217.810253:0:15800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851217.810274:0:15800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a8795780f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfef99 expref: -99 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.810380:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a8795780f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.810393:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a8795780f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.810404:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a8795780f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851217.810415:0:15800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788851217.810545:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59800/0x7ad3e1a8795780f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef99 expref: 20 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.810565:0:15800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a8795780f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef99 expref: 19 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851217.810591:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:1.0:1788851217.810594:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851217.810597:0:15800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58600, rc 0) 00000100:00100000:1.0:1788851217.810662:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+19:14477:x1875746000852096:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 444us (625us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788851217.810670:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 31 00000100:00100000:1.0:1788851217.831540:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851217.831589:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851217.831684:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000852224 00000100:00100000:2.0:1788851217.831695:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000852224 00000100:00100000:2.0:1788851217.831766:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:2.0:1788851217.831777:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+19:2354:x1875746000852224:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851217.831829:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851217.831854:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a8795780f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef99 expref: 19 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851217.831882:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:2.0:1788851217.831888:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851217.832026:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000852352 00000100:00100000:0.0:1788851217.832031:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000852352 00000100:00100000:0.0:1788851217.832076:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 32 00000100:00100000:0.0:1788851217.832084:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+19:14477:x1875746000852352:12345-192.168.204.6@tcp:54:lfs.0 00000100:00100000:2.0:1788851217.832300:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d76d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+19:2354:x1875746000852224:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 524us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851217.832309:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 0 00010000:00010000:0.0:1788851217.832965:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031c00/0x7ad3e1a879578105 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.832989:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031c00/0x7ad3e1a879578105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.833002:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031c00/0x7ad3e1a879578105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.833029:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031c00/0x7ad3e1a879578105 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.833036:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031c00/0x7ad3e1a879578105 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.833043:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031c00/0x7ad3e1a879578105 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.833050:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9a83031c00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851217.833054:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031c00/0x7ad3e1a879578105 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.833062:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031c00/0x7ad3e1a879578105 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.833071:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:0.0:1788851217.833075:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788851217.833079:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031c00/0x7ad3e1a879578105 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851217.833098:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031c00/0x7ad3e1a879578105 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851217.833359:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+18:14477:x1875746000852352:12345-192.168.204.6@tcp:54:lfs.0 Request processed in 1273us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851217.833369:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 32 00000100:00100000:0.0:1788851217.842308:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851217.842391:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000852608 00000100:00100000:3.0:1788851217.842402:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000852608 00000100:00100000:3.0:1788851217.842457:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:3.0:1788851217.842467:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+18:14477:x1875746000852608:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:3.0:1788851217.842762:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+19:14477:x1875746000852608:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 295us (463us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788851217.842771:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 7 00000100:00100000:3.0:1788851217.921349:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851217.921403:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851217.921439:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851217.921479:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851217.921521:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851217.921553:0:16008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000852992 00000100:00100000:2.0:1788851217.921566:0:16008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000852992 00000100:00100000:3.0:1788851217.921573:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000853248 00000100:00100000:3.0:1788851217.921581:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000853248 00000100:00100000:3.0:1788851217.921625:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000852864 00000100:00100000:2.0:1788851217.921626:0:16008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000853120 00000100:00100000:3.0:1788851217.921629:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000852864 00000100:00100000:2.0:1788851217.921631:0:16008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000853120 00000100:00100000:3.0:1788851217.921658:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:3.0:1788851217.921668:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee5876d3-dac7-4454-b807-f34f3453286e+5:2351:x1875746000853248:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:1.0:1788851217.921718:0:14383:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000852736 00000100:00100000:1.0:1788851217.921722:0:14383:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000852736 00000100:00100000:1.0:1788851217.921751:0:14383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 123 00000100:00100000:1.0:1788851217.921758:0:14383:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+13:2351:x1875746000852736:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851217.921920:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee5876d3-dac7-4454-b807-f34f3453286e+5:2351:x1875746000853248:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 254us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851217.921988:0:14383:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cdd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a9650a6c-0a31-41c0-9a66-788e070d6102+13:2351:x1875746000852736:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 230us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851217.921996:0:14383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 123 00000100:00100000:2.0:1788851217.929952:0:16008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:2.0:1788851217.929982:0:16008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+5:2351:x1875746000852992:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:2.0:1788851217.930064:0:16008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+5:2351:x1875746000852992:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 99us (8660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851217.930224:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:3.0:1788851217.930260:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:3.0:1788851217.930270:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafc91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+5:2351:x1875746000852864:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851217.930306:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafc91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+5:2351:x1875746000852864:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 39us (8825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851217.930313:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:3.0:1788851217.930326:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:3.0:1788851217.930333:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee5876d3-dac7-4454-b807-f34f3453286e+5:2351:x1875746000853120:12345-192.168.204.6@tcp:400:kworker.0 00000100:00100000:3.0:1788851217.930359:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ee5876d3-dac7-4454-b807-f34f3453286e+5:2351:x1875746000853120:12345-192.168.204.6@tcp:400:kworker.0 Request processed in 27us (8838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851217.930381:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00080000:3.0:1788851217.930441:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788851217.930446:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788851217.930746:0:16008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 14 00010000:00010000:0.0:1788851217.938161:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788851218.182494:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851218.182695:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000853504 00000100:00100000:3.0:1788851218.182707:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000853504 00000100:00100000:3.0:1788851218.182778:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:3.0:1788851218.182820:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+19:14508:x1875746000853504:12345-192.168.204.6@tcp:101:cat.0 00010000:00010000:3.0:1788851218.182847:0:15800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851218.182873:0:15800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a87957810c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfefa0 expref: -99 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851218.183004:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578113 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851218.183023:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578113 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851218.183039:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578113 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851218.183051:0:15800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788851218.183246:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a87957810c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefa0 expref: 22 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851218.183268:0:15800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578113 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefa0 expref: 21 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851218.183278:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:3.0:1788851218.183289:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851218.183294:0:15800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168ea00, rc 0) 00000100:00100000:3.0:1788851218.183379:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+21:14508:x1875746000853504:12345-192.168.204.6@tcp:101:cat.0 Request processed in 561us (911us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788851218.183388:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 33 00000100:00100000:0.0:1788851218.189201:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851218.189313:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000853632 00000100:00100000:1.0:1788851218.189323:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000853632 00000100:00100000:1.0:1788851218.189393:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:1.0:1788851218.189404:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+21:2352:x1875746000853632:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851218.189420:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851218.189447:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a879578113 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefa0 expref: 21 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851218.189466:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:1.0:1788851218.189494:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851218.189564:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+20:2352:x1875746000853632:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 162us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851218.189572:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 1 00000100:00100000:0.0:1788851218.205275:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851218.205361:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000853888 00000100:00100000:3.0:1788851218.205373:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000853888 00000100:00100000:3.0:1788851218.205433:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:3.0:1788851218.205444:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+20:14508:x1875746000853888:12345-192.168.204.6@tcp:35:cat.0 00000100:00100000:3.0:1788851218.206101:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+21:14508:x1875746000853888:12345-192.168.204.6@tcp:35:cat.0 Request processed in 658us (836us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788851218.206110:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 8 00000100:00100000:0.0:1788851218.310396:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851218.310520:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000854144 00000100:00100000:1.0:1788851218.310533:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000854144 00000100:00100000:1.0:1788851218.310595:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:1.0:1788851218.310607:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+21:14514:x1875746000854144:12345-192.168.204.6@tcp:101:dd.0 00010000:00010000:1.0:1788851218.310632:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851218.310654:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879578121 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfefa7 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851218.310766:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a879578128 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851218.310814:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a879578128 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851218.310829:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a879578128 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851218.310841:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788851218.311021:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a879578121 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefa7 expref: 24 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851218.311045:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a879578128 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefa7 expref: 23 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851218.311055:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:1.0:1788851218.311073:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788851218.311077:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59000, rc 0) 00000100:00100000:1.0:1788851218.311240:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+23:14514:x1875746000854144:12345-192.168.204.6@tcp:101:dd.0 Request processed in 634us (854us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788851218.311248:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 34 00000100:00100000:0.0:1788851218.320279:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851218.320387:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000854400 00000100:00100000:2.0:1788851218.320397:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000854400 00000100:00100000:2.0:1788851218.320452:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 35 00000100:00100000:2.0:1788851218.320461:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb45a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+23:14514:x1875746000854400:12345-192.168.204.6@tcp:36:dd.0 00010000:00010000:2.0:1788851218.320525:0:14389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788851218.320564:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a879578128 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefa7 expref: 23 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.320588:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58200/0x7ad3e1a8795780db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef8b expref: 22 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.320598:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:2.0:1788851218.320603:0:14389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851218.321178:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578136 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.321196:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578136 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.321207:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578136 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851218.321266:0:14389:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788851218.321306:0:14389:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000004884320 reply state 000000003759533e transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578136 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851218.321315:0:14389:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788851218.321440:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb45a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+24:14514:x1875746000854400:12345-192.168.204.6@tcp:36:dd.0 Request processed in 978us (1171us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788851218.321447:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 35 00000020:00080000:2.0:1788851218.321452:0:14389:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788851218.326450:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578136 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851218.326466:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578136 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851218.326474:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578136 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851218.326480:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851218.326494:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578136 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851218.326502:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578136 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851218.326519:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:0.0:1788851218.326550:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851218.326557:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578136 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851218.326564:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578136 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851218.437384:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851218.437570:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000854656 00000100:00100000:2.0:1788851218.437580:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000854656 00000100:00100000:2.0:1788851218.437633:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:2.0:1788851218.437643:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+23:14514:x1875746000854656:12345-192.168.204.6@tcp:35:dd.0 00000100:00100000:2.0:1788851218.437924:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+24:14514:x1875746000854656:12345-192.168.204.6@tcp:35:dd.0 Request processed in 281us (549us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788851218.437942:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 9 00000100:00100000:3.0:1788851218.609526:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851218.619205:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000854784 00000100:00100000:0.0:1788851218.619223:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000854784 00000100:00100000:2.0:1788851218.619600:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:2.0:1788851218.619612:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+24:14528:x1875746000854784:12345-192.168.204.6@tcp:101:stat.0 00010000:00010000:2.0:1788851218.619637:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851218.619660:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a87957813d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfefae expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.619726:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578144 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.619741:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578144 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.619753:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578144 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.619766:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a87957814b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.619820:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a87957814b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.619828:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a87957814b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.619934:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578152 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.619944:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578152 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.619951:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578152 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851218.619987:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788851218.619991:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788851218.620032:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578152 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620045:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578152 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620054:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578144 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620061:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578144 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620067:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578144 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620084:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851218.620088:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578144 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620096:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578144 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620117:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a9bbcd02000) 00010000:00010000:2.0:1788851218.620121:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851218.620126:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578144 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620132:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578144 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620147:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a87957814b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620153:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a87957814b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620160:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a87957814b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620165:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851218.620168:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a87957814b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620174:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a87957814b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620193:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a9bbcd02e00) 00010000:00010000:2.0:1788851218.620196:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851218.620199:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a87957814b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620204:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a87957814b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620238:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a87957813d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefae expref: 26 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620251:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578152 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefae expref: 25 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.620260:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:2.0:1788851218.620262:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851218.620265:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7000, rc 0) 00000100:00100000:2.0:1788851218.620328:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+25:14528:x1875746000854784:12345-192.168.204.6@tcp:101:stat.0 Request processed in 718us (10813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851218.620336:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 36 00000100:00100000:0.0:1788851218.717966:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851218.719827:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000855040 00000100:00100000:2.0:1788851218.719853:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000855040 00000100:00100000:2.0:1788851218.719960:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 37 00000100:00100000:2.0:1788851218.719975:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+25:14534:x1875746000855040:12345-192.168.204.6@tcp:36:truncate.0 00010000:00010000:2.0:1788851218.720056:0:14389:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851218.720091:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578152 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefae expref: 25 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.720140:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:2.0:1788851218.720148:0:14389:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788851218.720452:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578159 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.720471:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578159 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.720494:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578159 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851218.720559:0:14389:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:2.0:1788851218.720587:0:14389:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a1fdaa5 reply state 00000000c5898ccb transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578159 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851218.720597:0:14389:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788851218.720759:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+27:14534:x1875746000855040:12345-192.168.204.6@tcp:36:truncate.0 Request processed in 787us (2812us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788851218.720767:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 37 00000020:00080000:2.0:1788851218.720774:0:14389:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788851218.727282:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578159 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851218.727302:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578159 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851218.727310:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578159 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851218.727316:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851218.727322:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578159 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851218.727330:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578159 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851218.727348:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:1.0:1788851218.727352:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851218.727357:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578159 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851218.727363:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6200/0x7ad3e1a879578159 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851218.912116:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851218.912713:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000855168 00000100:00100000:2.0:1788851218.912735:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000855168 00000100:00100000:2.0:1788851218.913070:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 38 00000100:00100000:2.0:1788851218.913083:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+26:14548:x1875746000855168:12345-192.168.204.6@tcp:101:stat.0 00010000:00010000:2.0:1788851218.913209:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851218.913316:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578160 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfefb5 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913443:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879578167 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913460:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879578167 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913485:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879578167 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913502:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957816e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913509:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957816e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913516:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957816e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913630:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578175 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913639:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578175 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913645:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578175 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851218.913693:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:2.0:1788851218.913698:0:14390:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788851218.913720:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578175 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913744:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578175 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913902:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879578167 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913911:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879578167 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913919:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879578167 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913926:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af6600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851218.913931:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879578167 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913941:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879578167 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.913954:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a9bbcd02000) 00010000:00010000:2.0:1788851218.913958:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851218.914025:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879578167 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.914034:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af6600/0x7ad3e1a879578167 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.914052:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957816e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.914058:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957816e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.914072:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957816e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.914077:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:2.0:1788851218.914081:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957816e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.914088:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957816e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.914165:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a9bbcd02e00) 00010000:00010000:2.0:1788851218.914169:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788851218.914173:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957816e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.914179:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957816e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.914222:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a879578160 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefb5 expref: 28 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.914236:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578175 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefb5 expref: 27 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851218.914325:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:2.0:1788851218.914328:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788851218.914331:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7600, rc 0) 00000100:00100000:2.0:1788851218.914429:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+27:14548:x1875746000855168:12345-192.168.204.6@tcp:101:stat.0 Request processed in 1348us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851218.914447:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 38 00010000:00010000:1.0:1788851218.966365:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788851219.040875:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.041022:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000855424 00000100:00100000:2.0:1788851219.041033:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000855424 00000100:00100000:2.0:1788851219.041102:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00100000:2.0:1788851219.041114:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+27:14558:x1875746000855424:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:2.0:1788851219.041134:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851219.041154:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a87957817c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfefbc expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788851219.041246:0:14389:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788851219.041366:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a87957817c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefbc expref: 29 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.041379:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02700) 00010000:00010000:2.0:1788851219.041382:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788851219.041387:0:14389:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a87957817c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefbc expref: 29 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.041400:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7000, rc 0) 00000100:00100000:2.0:1788851219.041465:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+28:14558:x1875746000855424:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 355us (602us total) trans 8589934614 rc 301/301 00000100:00100000:2.0:1788851219.041482:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 39 00000100:00080000:3.0:1788851219.041544:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788851219.047736:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.047939:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000855680 00000100:00100000:2.0:1788851219.047950:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000855680 00000100:00100000:2.0:1788851219.048009:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:2.0:1788851219.048020:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d4d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+28:14558:x1875746000855680:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1788851219.048296:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d4d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+29:14558:x1875746000855680:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 277us (568us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788851219.048304:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 10 00000100:00100000:0.0:1788851219.126640:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851219.126746:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000855936 00000100:00100000:3.0:1788851219.126764:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000855936 00000100:00100000:3.0:1788851219.126893:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 40 00000100:00100000:3.0:1788851219.126905:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+29:14564:x1875746000855936:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1788851219.126954:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851219.126984:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a87957818a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfefc3 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.127143:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.127162:0:14388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a8795780c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef84 expref: 30 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.127197:0:14388:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578175 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefb5 expref: 30 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.127207:0:14388:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.127254:0:14388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578175 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefb5 expref: 30 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.127272:0:14388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578175 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefb5 expref: 30 pid: 14390 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851219.127289:0:14388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14388:1875746019716608:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851219.127442:0:14388:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a8795780c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef84 expref: 30 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.127453:0:14388:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a8795780c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef84 expref: 30 pid: 14388 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851219.127462:0:14388:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3666680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14388:1875746019716736:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851219.127506:0:14388:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98a21180 going to sleep for 11 seconds 00000100:00100000:1.0:1788851219.134027:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851219.134083:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851219.134449:0:14388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14388:1875746019716608:192.168.204.6@tcp:104: 00000100:00100000:3.0:1788851219.134464:0:14388:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3666680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14388:1875746019716736:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851219.134514:0:14388:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851219.136529:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000856064 00000100:00100000:0.0:1788851219.136551:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000856064 00010000:00010000:0.0:1788851219.136694:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a8795780c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef84 expref: 31 pid: 14388 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851219.136753:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000856192 00000100:00100000:0.0:1788851219.136757:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000856192 00010000:00010000:0.0:1788851219.136774:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578175 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefb5 expref: 32 pid: 14390 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851219.136810:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:0.0:1788851219.136821:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bc1cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+32:2353:x1875746000856064:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851219.136843:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851219.136851:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a8795780c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef84 expref: 32 pid: 14388 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.136884:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a8795780c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef84 expref: 32 pid: 14388 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.136915:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a8795780c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfef84 expref: 32 pid: 14388 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.137265:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:0.0:1788851219.137271:0:14373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.137281:0:14373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.137289:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851219.137420:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bc1cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+31:2353:x1875746000856064:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 599us (3405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851219.137429:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:0.0:1788851219.137506:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:0.0:1788851219.137515:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+30:2353:x1875746000856192:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851219.137525:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851219.137531:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578175 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefb5 expref: 30 pid: 14390 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.137542:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578175 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefb5 expref: 30 pid: 14390 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.137575:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7600/0x7ad3e1a879578175 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefb5 expref: 30 pid: 14390 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.137585:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:0.0:1788851219.137590:0:14373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.137599:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.138197:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.138235:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851219.138270:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+29:2353:x1875746000856192:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 756us (4193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851219.138280:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 12 00010000:00010000:0.0:1788851219.138353:0:14388:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.138363:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851219.138388:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788851219.140017:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a87957818a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefc3 expref: 30 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.140061:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefc3 expref: 29 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.140096:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:0.0:1788851219.140100:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788851219.140105:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f800, rc 0) 00000100:00100000:0.0:1788851219.140170:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+29:14564:x1875746000855936:12345-192.168.204.6@tcp:101:bash.0 Request processed in 13266us (13545us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1788851219.140179:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 40 00000100:00100000:0.0:1788851219.143977:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.144451:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000856448 00000100:00100000:2.0:1788851219.144477:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000856448 00000100:00100000:2.0:1788851219.144565:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 41 00000100:00100000:2.0:1788851219.144577:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+29:14564:x1875746000856448:12345-192.168.204.6@tcp:36:bash.0 00010000:00010000:2.0:1788851219.145155:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a87957819f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.145179:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a87957819f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.145193:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a87957819f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788851219.145254:0:14389:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:2.0:1788851219.145283:0:14389:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e9f3bcd7 reply state 000000000ffd38dd transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a87957819f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851219.145293:0:14389:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788851219.145617:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+32:14564:x1875746000856448:12345-192.168.204.6@tcp:36:bash.0 Request processed in 1040us (1652us total) trans 8589934618 rc 0/0 00000100:00100000:2.0:1788851219.145628:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 41 00000020:00080000:2.0:1788851219.145634:0:14389:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788851219.154285:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00010000:00010000:3.0:1788851219.160857:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a87957819f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.160882:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a87957819f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.160892:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a87957819f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.160900:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851219.160906:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a87957819f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.160927:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a87957819f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.160950:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:3.0:1788851219.160954:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851219.160960:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a87957819f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.160966:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7000/0x7ad3e1a87957819f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851219.161186:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000856576 00000100:00100000:2.0:1788851219.161202:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000856576 00000100:00100000:2.0:1788851219.161290:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:2.0:1788851219.161303:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+31:14564:x1875746000856576:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:2.0:1788851219.161356:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851219.161381:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a8795781a6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfefca expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.161459:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a8795781a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefca expref: 32 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.161489:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a8795781a6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefca expref: 32 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.161513:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:2.0:1788851219.161517:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788851219.161520:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7800, rc 0) 00000100:00100000:2.0:1788851219.161605:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+32:14564:x1875746000856576:12345-192.168.204.6@tcp:101:bash.0 Request processed in 304us (7336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851219.161613:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 42 00000100:00100000:0.0:1788851219.173954:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851219.174173:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000856704 00000100:00100000:1.0:1788851219.174188:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000856704 00000100:00100000:1.0:1788851219.174269:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:1.0:1788851219.174281:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+32:14564:x1875746000856704:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1788851219.174308:0:15800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851219.174338:0:15800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795781ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfefd1 expref: -99 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.174448:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.174477:0:15800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefc3 expref: 33 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.174490:0:15800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781b4 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.174532:0:15800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefc3 expref: 33 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.174546:0:15800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefc3 expref: 33 pid: 14388 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851219.174562:0:15800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d76a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15800:1875746019716864:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851219.174668:0:15800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c18f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788851219.178571:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851219.178710:0:15800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d76a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15800:1875746019716864:192.168.204.6@tcp:104: 00010000:00010000:3.0:1788851219.178752:0:15800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851219.178861:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000856832 00000100:00100000:0.0:1788851219.178871:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000856832 00010000:00010000:0.0:1788851219.178935:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefc3 expref: 34 pid: 14388 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851219.178987:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:0.0:1788851219.178998:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+34:2354:x1875746000856832:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788851219.179017:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851219.179026:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefc3 expref: 34 pid: 14388 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.179041:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefc3 expref: 34 pid: 14388 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.179070:0:14373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a879578191 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefc3 expref: 34 pid: 14388 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.179114:0:14373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:0.0:1788851219.179120:0:14373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.179131:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.179140:0:14373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781b4 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.179175:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788851219.179244:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+33:2354:x1875746000856832:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 247us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851219.179253:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00010000:00010000:3.0:1788851219.179439:0:15800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.179460:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851219.179533:0:15800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788851219.179538:0:15800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788851219.179561:0:15800:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.179600:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a8795781ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefd1 expref: 33 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.179619:0:15800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefd1 expref: 32 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.179628:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:3.0:1788851219.179631:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788851219.179634:0:15800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59e00, rc 0) 00000100:00100000:3.0:1788851219.179666:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+32:14564:x1875746000856704:12345-192.168.204.6@tcp:101:bash.0 Request processed in 5388us (5739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851219.179674:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 43 00000100:00100000:0.0:1788851219.184089:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851219.184395:0:14375:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000857088 00000100:00100000:1.0:1788851219.184408:0:14375:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000857088 00000100:00100000:1.0:1788851219.184505:0:14375:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:1.0:1788851219.184538:0:14375:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b8bcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+32:14564:x1875746000857088:12345-192.168.204.6@tcp:103:bash.0 00010000:00010000:1.0:1788851219.184558:0:14375:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788851219.184593:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefd1 expref: 32 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.184632:0:14375:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a8795781a6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefca expref: 31 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.184644:0:14375:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9b84f2f400) 00010000:00010000:1.0:1788851219.184658:0:14375:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851219.184821:0:14375:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b8bcf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+30:14564:x1875746000857088:12345-192.168.204.6@tcp:103:bash.0 Request processed in 286us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851219.184830:0:14375:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 2 00000100:00100000:1.0:1788851219.193352:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.193541:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000857216 00000100:00100000:2.0:1788851219.193555:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000857216 00000100:00100000:2.0:1788851219.193641:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:2.0:1788851219.193653:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+30:14564:x1875746000857216:12345-192.168.204.6@tcp:58:bash.0 00010000:00010000:2.0:1788851219.194011:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a8795781bb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.194033:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a8795781bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.194048:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a8795781bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788851219.198147:0:14390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788851219.198342:0:14390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788851219.198427:0:14390:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788851219.198841:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+30:14564:x1875746000857216:12345-192.168.204.6@tcp:58:bash.0 Request processed in 5181us (5497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851219.198856:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 44 00000100:00100000:2.0:1788851219.201601:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851219.201776:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000857344 00000100:00100000:0.0:1788851219.201880:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000857344 00000100:00100000:1.0:1788851219.202254:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 45 00000100:00100000:1.0:1788851219.202268:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+30:14564:x1875746000857344:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:1.0:1788851219.202296:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851219.202322:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfefd8 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.202393:0:14389:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a8795781bb lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.202404:0:14389:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781c2 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefd8 expref: 31 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.202426:0:14389:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a8795781bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.202458:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781c2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefd8 expref: 31 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.202485:0:14389:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9bbcd02e00) 00010000:00010000:1.0:1788851219.202489:0:14389:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788851219.202493:0:14389:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781c2 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefd8 expref: 31 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.202500:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef59e00, rc 0) 00000100:00100000:1.0:1788851219.202575:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+31:14564:x1875746000857344:12345-192.168.204.6@tcp:101:bash.0 Request processed in 310us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851219.202581:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 45 00000040:00080000:1.0:1788851219.410292:0:14423:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788851219.410302:0:14423:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851219.410342:0:14423:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788851219.410348:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788851219.410481:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b87d76a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14423:1875746019716992:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788851219.410586:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c18840 going to sleep for 11 seconds 00000100:00100000:1.0:1788851219.413749:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b87d76a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14423:1875746019716992:192.168.204.6@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788851219.414367:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851219.414601:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000857472 00000100:00100000:1.0:1788851219.414609:0:14399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000857472 00000100:00100000:1.0:1788851219.414660:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:1.0:1788851219.414670:0:14399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a20f2a44-3f34-4fab-952c-679d966a5b8b+31:14565:x1875746000857472:12345-192.168.204.6@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788851219.415026:0:14399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf040000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a20f2a44-3f34-4fab-952c-679d966a5b8b+31:14565:x1875746000857472:12345-192.168.204.6@tcp:900:lhsmtool_posix.0 Request processed in 356us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851219.415150:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 0 00000100:00100000:2.0:1788851219.420028:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851219.424414:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000857600 00000100:00100000:3.0:1788851219.424430:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000857600 00000100:00100000:3.0:1788851219.424561:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:3.0:1788851219.424573:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+31:14565:x1875746000857600:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788851219.424605:0:14388:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788851219.424730:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+31:14565:x1875746000857600:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 159us (4711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851219.424758:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 46 00000100:00100000:0.0:1788851219.428436:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851219.428613:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000857728 00000100:00100000:3.0:1788851219.428623:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000857728 00000100:00100000:3.0:1788851219.428684:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:3.0:1788851219.428694:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+31:14565:x1875746000857728:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788851219.428766:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a8795781c9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.428802:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a8795781c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.428814:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a8795781c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.428880:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795781d0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.428888:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795781d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.428894:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795781d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.428929:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795781d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.428937:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795781d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.428944:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795781d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788851219.428991:0:15800:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788851219.428995:0:15800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788851219.429007:0:15800:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795781d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429017:0:15800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a8795781c9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429023:0:15800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a8795781c9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429029:0:15800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a8795781c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429035:0:15800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ea00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851219.429040:0:15800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a8795781c9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429047:0:15800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a8795781c9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429059:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a9b9199ac00) 00010000:00010000:3.0:1788851219.429062:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851219.429067:0:15800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a8795781c9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429074:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a8795781c9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429088:0:15800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795781d0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429104:0:15800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795781d0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429109:0:15800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795781d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429114:0:15800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851219.429117:0:15800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795781d0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429124:0:15800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795781d0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429132:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8a9b84f2fd00) 00010000:00010000:3.0:1788851219.429135:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851219.429137:0:15800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795781d0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429143:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a8795781d0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429159:0:15800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795781d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429165:0:15800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795781d7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429171:0:15800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795781d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429175:0:15800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851219.429184:0:15800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795781d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429191:0:15800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795781d7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429198:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9bbcd02e00) 00010000:00010000:3.0:1788851219.429201:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851219.429203:0:15800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795781d7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.429210:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a8795781d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851219.429290:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+31:14565:x1875746000857728:12345-192.168.204.6@tcp:34:lhsmtool_posix.0 Request processed in 597us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851219.429298:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 47 00000100:00100000:1.0:1788851219.433742:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851219.437483:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000857984 00000100:00100000:0.0:1788851219.437506:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000857984 00000100:00100000:0.0:1788851219.437622:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:0.0:1788851219.437635:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+31:14565:x1875746000857984:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851219.437663:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851219.437693:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030e00/0x7ad3e1a8795781de lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfefdf expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.437857:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a8795781e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.437896:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a8795781e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.437911:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a8795781e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851219.437928:0:14390:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788851219.438065:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a8795781e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.438075:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a8795781e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.438085:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a8795781e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.438092:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9a83031400 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851219.438097:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a8795781e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.438106:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a8795781e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.438121:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9bbcd02e00) 00010000:00010000:0.0:1788851219.438125:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788851219.438131:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a8795781e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.438139:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a8795781e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.438198:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030e00/0x7ad3e1a8795781de lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefdf expref: 33 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.438218:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8a9b9199ac00) 00010000:00010000:0.0:1788851219.438221:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788851219.438226:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030e00/0x7ad3e1a8795781de lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefdf expref: 33 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.438238:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9a83030e00, rc 0) 00000100:00100000:0.0:1788851219.438333:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+32:14565:x1875746000857984:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 701us (4607us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1788851219.438342:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 48 00000100:00100000:2.0:1788851219.441498:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851219.441586:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000858112 00000100:00100000:3.0:1788851219.441611:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000858112 00000100:00100000:3.0:1788851219.441689:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:3.0:1788851219.441701:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+32:14565:x1875746000858112:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788851219.441755:0:15800:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788851219.441983:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+32:14565:x1875746000858112:12345-192.168.204.6@tcp:53:lhsmtool_posix.0 Request processed in 283us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851219.441991:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 49 00000100:00100000:1.0:1788851219.448252:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851219.448484:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000858368 00000100:00100000:0.0:1788851219.448498:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000858368 00000100:00100000:0.0:1788851219.448572:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:0.0:1788851219.448585:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+32:14565:x1875746000858368:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851219.448614:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851219.448642:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031200/0x7ad3e1a8795781f3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfefe6 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788851219.449761:0:14390:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1788851219.449771:0:14390:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788851219.449880:0:14390:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788851219.450211:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030c00/0x7ad3e1a8795781fa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.450230:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030c00/0x7ad3e1a8795781fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.450243:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030c00/0x7ad3e1a8795781fa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.450325:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031200/0x7ad3e1a8795781f3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefe6 expref: 35 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.450346:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030c00/0x7ad3e1a8795781fa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefe6 expref: 34 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.450355:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a9b990e2d00) 00010000:00010000:0.0:1788851219.450358:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788851219.450362:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9a83030c00, rc 0) 00000100:00100000:0.0:1788851219.450451:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+34:14565:x1875746000858368:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 1869us (2215us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788851219.450469:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 50 00000100:00100000:3.0:1788851219.454991:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851219.455237:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000858624 00000100:00100000:1.0:1788851219.455253:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000858624 00000100:00100000:1.0:1788851219.455336:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:1.0:1788851219.455350:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+34:14565:x1875746000858624:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788851219.455430:0:15800:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851219.455489:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030c00/0x7ad3e1a8795781fa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefe6 expref: 34 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455514:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a9b990e2d00) 00010000:00010000:1.0:1788851219.455529:0:15800:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788851219.455559:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578208 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455575:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578208 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455587:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578208 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455604:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a87957820f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa8ef6db2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455611:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a87957820f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa8ef6db2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455618:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a87957820f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa8ef6db2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455717:0:15800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578208 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455726:0:15800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578208 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455734:0:15800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578208 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455742:0:15800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851219.455747:0:15800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578208 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455757:0:15800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578208 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455767:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a9bbcd02000) 00010000:00010000:1.0:1788851219.455770:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851219.455776:0:15800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578208 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455821:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578208 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455833:0:15800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a87957820f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa8ef6db2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455839:0:15800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a87957820f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa8ef6db2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455846:0:15800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a87957820f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa8ef6db2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455861:0:15800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59600 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:1.0:1788851219.455864:0:15800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a87957820f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa8ef6db2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455871:0:15800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a87957820f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xa8ef6db2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455880:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xa8ef6db2 (ffff8a9b9199aa00) 00010000:00010000:1.0:1788851219.455883:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788851219.455886:0:15800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a87957820f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa8ef6db2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.455893:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59600/0x7ad3e1a87957820f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xa8ef6db2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851219.456014:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+33:14565:x1875746000858624:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 667us (1039us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788851219.456022:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 51 00000100:00100000:2.0:1788851219.461378:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851219.461472:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000858752 00000100:00100000:0.0:1788851219.461486:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000858752 00000100:00100000:0.0:1788851219.461558:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:0.0:1788851219.461570:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+33:14565:x1875746000858752:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788851219.461598:0:14390:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851219.461627:0:14390:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030e00/0x7ad3e1a879578216 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfefed expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.461675:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a87957821d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.461692:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a87957821d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.461705:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a87957821d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.461903:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030e00/0x7ad3e1a879578216 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefed expref: 35 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.461937:0:14390:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031400/0x7ad3e1a87957821d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefed expref: 34 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.461947:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a9b990e2c00) 00010000:00010000:0.0:1788851219.461951:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788851219.461955:0:14390:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9a83031400, rc 0) 00000100:00100000:0.0:1788851219.462036:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+34:14565:x1875746000858752:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 467us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851219.462045:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 52 00000100:00100000:3.0:1788851219.473754:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851219.474523:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788851219.474551:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019717120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788851219.474642:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788851219.475029:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019717632:0@lo:400:kworker.0 00000100:00100000:2.0:1788851219.475071:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851219.475118:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3309:1875746019717248:0@lo:400:kworker.0 00000100:00100000:3.0:1788851219.475156:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851219.475193:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019717760:0@lo:400:kworker.0 00000100:00100000:3.0:1788851219.475246:0:15075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019717120 00000100:00100000:3.0:1788851219.475257:0:15075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019717120 00000100:00100000:3.0:1788851219.475330:0:15075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788851219.475341:0:15075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019717120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788851219.475387:0:15075:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788851219.475444:0:15075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875746019717120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851219.475470:0:15075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788851219.475498:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851219.475519:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019717504:0@lo:400:kworker.0 00000100:00100000:3.0:1788851219.475558:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019717376:0@lo:400:kworker.0 00000100:00100000:3.0:1788851219.475587:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851219.475623:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019717376 00000100:00100000:3.0:1788851219.475627:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019717376 00000100:00100000:3.0:1788851219.475663:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788851219.475671:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019717376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851219.475711:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019717376:12345-0@lo:400:kworker.0 Request processed in 41us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851219.475718:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788851219.475740:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788851219.475771:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019717376:0@lo:400:kworker.0 00000100:00100000:0.0:1788851219.476286:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019717248 00000100:00100000:0.0:1788851219.476293:0:14380:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019717248 00000100:00100000:0.0:1788851219.476340:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788851219.476349:0:14380:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:3309:x1875746019717248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788851219.476406:0:14380:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:88a8a83d-2380-4e6d-b8f7-1327e5aed605+19:3309:x1875746019717248:12345-0@lo:400:kworker.0 Request processed in 58us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851219.476413:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788851219.477525:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851219.478097:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000859008 00000100:00100000:1.0:1788851219.478109:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000859008 00000100:00100000:1.0:1788851219.478209:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019717632 00000100:00100000:1.0:1788851219.478213:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019717632 00000100:00080000:1.0:1788851219.478240:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788851219.478617:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851219.478720:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019717504 00000100:00100000:3.0:1788851219.478727:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019717504 00000100:00100000:3.0:1788851219.478756:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788851219.478766:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019717632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851219.478874:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875746019717632:12345-0@lo:400:kworker.0 Request processed in 110us (3802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851219.478881:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788851219.478904:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788851219.478923:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019717504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851219.478957:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875746019717504:12345-0@lo:400:kworker.0 Request processed in 47us (1437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851219.478964:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788851219.478989:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:3.0:1788851219.478996:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+34:14565:x1875746000859008:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788851219.479281:0:14389:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578224 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.479303:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578224 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.479317:0:14389:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578224 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788851219.480905:0:14389:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1788851219.480929:0:14389:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 552422147111ns, next at 553422142618ns, rc = 0 00000100:00100000:2.0:1788851219.481159:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1875746019717120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788851219.481208:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:88a8a83d-2380-4e6d-b8f7-1327e5aed605:3309:1875746019717248:0@lo:400:kworker.0 00000100:00100000:2.0:1788851219.481246:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99173800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875746019717504:0@lo:400:kworker.0 00000100:00100000:2.0:1788851219.481279:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99170e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1875746019717632:0@lo:400:kworker.0 00000100:00100000:0.0:1788851219.481335:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019717760 00000100:00100000:0.0:1788851219.481343:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019717760 00000100:00080000:1.0:1788851219.481534:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1788851219.481578:0:14389:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5f4774a reply state 00000000711cebfe transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578224 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851219.481610:0:14389:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788851219.481689:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788851219.481703:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019717760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788851219.481747:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+36:14565:x1875746000859008:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 2746us (8004us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1788851219.481758:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 53 00000100:00100000:0.0:1788851219.482188:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875746019717760:12345-0@lo:400:kworker.0 Request processed in 486us (3569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851219.482197:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788851219.482880:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1875746019717760:0@lo:400:kworker.0 00010000:00010000:3.0:1788851219.486235:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578224 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.486256:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578224 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.486265:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578224 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.486275:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f200 already unused, calling callback (ffffffffc20f24f0) 00000100:00100000:1.0:1788851219.486284:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00010000:00010000:3.0:1788851219.486285:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578224 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.486300:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578224 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.486317:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a9b990e2c00) 00010000:00010000:3.0:1788851219.486321:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788851219.486327:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578224 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.486336:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a879578224 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14389 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851219.486884:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000859136 00000100:00100000:2.0:1788851219.486898:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000859136 00000100:00100000:2.0:1788851219.486995:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:2.0:1788851219.487008:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+35:14565:x1875746000859136:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851219.487059:0:15800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851219.487087:0:15800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957822b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeff4 expref: -99 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.487165:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957822b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeff4 expref: 36 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.487182:0:15800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957822b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeff4 expref: 36 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.487204:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a9b990e2c00) 00010000:00010000:2.0:1788851219.487207:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788851219.487212:0:15800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af7800, rc 0) 00000100:00100000:2.0:1788851219.487288:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+36:14565:x1875746000859136:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 284us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851219.487296:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 54 00000100:00100000:1.0:1788851219.490135:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.492134:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000859264 00000100:00100000:2.0:1788851219.492154:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000859264 00000100:00100000:2.0:1788851219.492267:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:2.0:1788851219.492280:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+5:2354:x1875746000859264:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788851219.492818:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:2354:x1875746000859264:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 499us (2655us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788851219.492829:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00080000:1.0:1788851219.494225:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788851219.498606:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.498960:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000859520 00000100:00100000:2.0:1788851219.498976:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000859520 00000100:00100000:2.0:1788851219.499053:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:2.0:1788851219.499065:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+36:14565:x1875746000859520:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788851219.499406:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+37:14565:x1875746000859520:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 341us (823us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788851219.499415:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 11 00000100:00100000:3.0:1788851219.502067:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.502251:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000859776 00000100:00100000:2.0:1788851219.502263:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000859776 00000100:00100000:2.0:1788851219.502401:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:2.0:1788851219.502414:0:14389:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+37:14565:x1875746000859776:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788851219.502576:0:14389:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+37:14565:x1875746000859776:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 163us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851219.502584:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 55 00000100:00100000:3.0:1788851219.505658:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851219.506329:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000859904 00000100:00100000:1.0:1788851219.506344:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000859904 00000100:00100000:1.0:1788851219.506431:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:1.0:1788851219.506474:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+37:14565:x1875746000859904:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788851219.506503:0:15800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788851219.506532:0:15800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578232 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cfeffb expref: -99 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.506642:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578239 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.506664:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.506679:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788851219.506731:0:15800:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788851219.506754:0:15800:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.506809:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58400/0x7ad3e1a879578232 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeffb expref: 39 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.506831:0:15800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578239 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeffb expref: 38 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.506841:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a9b990e2c00) 00010000:00010000:1.0:1788851219.506844:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788851219.506848:0:15800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9baef58600, rc 0) 00000100:00100000:1.0:1788851219.506934:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+38:14565:x1875746000859904:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 473us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851219.506953:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 56 00000100:00100000:1.0:1788851219.510017:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851219.510156:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000860032 00000100:00100000:3.0:1788851219.510170:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000860032 00000100:00100000:3.0:1788851219.510247:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:3.0:1788851219.510262:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+6:2353:x1875746000860032:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788851219.510288:0:15072:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851219.510318:0:15072:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c140c75/0x7ad3e1a879578240 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cff002 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851219.510353:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9fb413, blocks: 0x1 00010000:00010000:3.0:1788851219.510379:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1788851219.510385:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851219.510396:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c140c75/0x7ad3e1a879578240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff002 expref: 7 pid: 15072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.510420:0:15072:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008c140c75/0x7ad3e1a879578240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff002 expref: 7 pid: 15072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.510436:0:15072:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f200, rc 0) 00000100:00100000:3.0:1788851219.510518:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+7:2353:x1875746000860032:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 259us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851219.510526:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:3.0:1788851219.513407:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.513469:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000860288 00000100:00100000:2.0:1788851219.513483:0:14389:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000860288 00000100:00100000:2.0:1788851219.513565:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:2.0:1788851219.513577:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+38:14565:x1875746000860288:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788851219.514062:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+38:14565:x1875746000860288:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 483us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851219.514072:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 57 00000100:00100000:1.0:1788851219.520585:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851219.520762:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000860416 00000100:00100000:3.0:1788851219.520775:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000860416 00000100:00100000:3.0:1788851219.520894:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:3.0:1788851219.520916:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b87d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+38:14565:x1875746000860416:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788851219.578433:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:0.0:1788851219.578454:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:0.0:1788851219.578488:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1788851219.578502:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000001:00080000:0.0:1788851219.578521:0:5883:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:0.0:1788851219.578539:0:5883:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788851219.578696:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019717888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788851219.578763:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788851219.578862:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019717888 00000100:00100000:0.0:1788851219.578870:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019717888 00000100:00100000:0.0:1788851219.578929:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788851219.578939:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875746019717888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788851219.579104:0:15073:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788851219.579107:0:15073:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788851219.579110:0:15073:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788851219.579111:0:15073:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788851219 -> 1788851219 00002000:00010000:0.0:1788851219.579114:0:15073:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788851219.579150:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99171f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875746019717888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 213us (387us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788851219.579157:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788851219.579197:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8a9b99172d80/2, rc 0, transno 8589934595 00000100:00100000:0.0:1788851219.579203:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1875746019717888:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788851219.579525:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b87d75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+13:14565:x1875746000860416:12345-192.168.204.6@tcp:44:lhsmtool_posix.0 Request processed in 58617us (58954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851219.579533:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 58 00000100:00100000:3.0:1788851219.584893:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851219.584992:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000860544 00000100:00100000:0.0:1788851219.585009:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000860544 00000100:00100000:1.0:1788851219.585183:0:16008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:1.0:1788851219.585198:0:16008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+7:2354:x1875746000860544:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788851219.585324:0:16008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+7:2354:x1875746000860544:12345-192.168.204.6@tcp:16:lhsmtool_posix.0 Request processed in 130us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851219.585332:0:16008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:0.0:1788851219.588235:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.589505:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000860800 00000100:00100000:2.0:1788851219.589522:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000860800 00000100:00100000:0.0:1788851219.592833:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 59 00000100:00100000:0.0:1788851219.592852:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+13:14565:x1875746000860800:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788851219.592960:0:14388:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788851219.592996:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58600/0x7ad3e1a879578239 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeffb expref: 13 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.593025:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a9b990e2c00) 00010000:00010000:0.0:1788851219.593031:0:14388:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788851219.593076:0:14388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031200/0x7ad3e1a879578247 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.593094:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031200/0x7ad3e1a879578247 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.593105:0:14388:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031200/0x7ad3e1a879578247 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788851219.593360:0:14388:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b71384b reply state 00000000aa121f32 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031200/0x7ad3e1a879578247 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851219.593372:0:14388:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788851219.593519:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+14:14565:x1875746000860800:12345-192.168.204.6@tcp:36:lhsmtool_posix.0 Request processed in 670us (5298us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788851219.593527:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 59 00010000:00010000:0.0:1788851219.596198:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031200/0x7ad3e1a879578247 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.596222:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031200/0x7ad3e1a879578247 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.596230:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031200/0x7ad3e1a879578247 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.596255:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9a83031200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:0.0:1788851219.596261:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031200/0x7ad3e1a879578247 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.596270:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031200/0x7ad3e1a879578247 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.596294:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a9b990e2c00) 00010000:00010000:0.0:1788851219.596298:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788851219.596304:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031200/0x7ad3e1a879578247 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.596311:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83031200/0x7ad3e1a879578247 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14388 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851219.598741:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.598862:0:15073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000860928 00000100:00100000:2.0:1788851219.598882:0:15073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000860928 00000100:00100000:2.0:1788851219.598970:0:15073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:2.0:1788851219.598983:0:15073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+7:14565:x1875746000860928:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788851219.599001:0:15073:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788851219.599022:0:15073:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a87957824e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cff009 expref: -99 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.599084:0:15073:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008c140c75/0x7ad3e1a879578240 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff002 expref: 8 pid: 15072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.599094:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851219.599098:0:15073:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851219.599104:0:15073:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a87957824e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff009 expref: 8 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.599141:0:15073:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008c140c75/0x7ad3e1a879578240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff002 expref: 8 pid: 15072 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.599156:0:15073:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008c140c75/0x7ad3e1a879578240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff002 expref: 8 pid: 15072 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851219.599173:0:15073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15073:1875746019718016:192.168.204.6@tcp:104: 00000100:00100000:2.0:1788851219.599281:0:15073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8623d240 going to sleep for 11 seconds 00000100:00100000:2.0:1788851219.602223:0:15073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15073:1875746019718016:192.168.204.6@tcp:104: 00010000:00010000:2.0:1788851219.602268:0:15073:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a87957824e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff009 expref: 8 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.602291:0:15073:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b98af6600, rc 0) 00000100:00100000:2.0:1788851219.602398:0:15073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+8:14565:x1875746000860928:12345-192.168.204.6@tcp:101:lhsmtool_posix.0 Request processed in 3416us (3669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851219.602433:0:15073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 17 00000100:00100000:1.0:1788851219.603012:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.603376:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000861056 00000100:00100000:2.0:1788851219.603385:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000861056 00010000:00010000:2.0:1788851219.603418:0:14374:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008c140c75/0x7ad3e1a879578240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff002 expref: 8 pid: 15072 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851219.603498:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:2.0:1788851219.603508:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+8:2354:x1875746000861056:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851219.603522:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851219.603544:0:14374:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008c140c75/0x7ad3e1a879578240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff002 expref: 8 pid: 15072 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.603558:0:14374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008c140c75/0x7ad3e1a879578240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff002 expref: 8 pid: 15072 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.603580:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c140c75/0x7ad3e1a879578240 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff002 expref: 8 pid: 15072 timeout: 652 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.603599:0:14374:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851219.603603:0:14374:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788851219.603609:0:14374:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a87957824e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff009 expref: 7 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.603620:0:14374:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a87957824e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff009 expref: 7 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.603674:0:14374:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a87957824e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff009 expref: 7 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851219.603688:0:14374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bafcf0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14374:1875746019718144:192.168.204.6@tcp:105: 00000100:00100000:2.0:1788851219.603765:0:14374:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8623d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788851219.608630:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.609416:0:14374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bafcf0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14374:1875746019718144:192.168.204.6@tcp:105: 00010000:00010000:2.0:1788851219.609455:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851219.609494:0:16008:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000861184 00000100:00100000:1.0:1788851219.609503:0:16008:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000861184 00000100:00100000:2.0:1788851219.609530:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+8:2354:x1875746000861056:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 6022us (6518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851219.609550:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:1.0:1788851219.609625:0:16008:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:1.0:1788851219.609638:0:16008:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+7:2353:x1875746000861184:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788851219.610468:0:16008:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788851219.610474:0:16008:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788851218 00002000:00010000:1.0:1788851219.610477:0:16008:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788851217 00002000:00010000:1.0:1788851219.610479:0:16008:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788851219 -> 1788851218 00002000:00010000:1.0:1788851219.610482:0:16008:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788851219.610521:0:16008:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99173b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+8:2353:x1875746000861184:12345-192.168.204.6@tcp:2:lhsmtool_posix.0 Request processed in 884us (1898us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788851219.611412:0:16008:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 18 00000100:00100000:3.0:1788851219.627173:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851219.627574:0:15074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000861312 00000100:00100000:0.0:1788851219.627591:0:15074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000861312 00000100:00100000:0.0:1788851219.627666:0:15074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:0.0:1788851219.627677:0:15074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+8:2352:x1875746000861312:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788851219.627725:0:15074:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879578255 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.627746:0:15074:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a87957824e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff009 expref: 8 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.627755:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788851219.627773:0:15074:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788851219.627778:0:15074:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879578255 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.627874:0:15074:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a87957824e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff009 expref: 8 pid: 15073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.627889:0:15074:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a87957824e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff009 expref: 8 pid: 15073 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851219.627906:0:15074:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9b99173480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15074:1875746019718272:192.168.204.6@tcp:104: 00000100:00100000:0.0:1788851219.627995:0:15074:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8696a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788851219.634609:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:1.0:1788851219.634751:0:14373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000861440 00000100:00100000:1.0:1788851219.634768:0:14373:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000861440 00010000:00010000:1.0:1788851219.634864:0:14373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a87957824e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff009 expref: 9 pid: 15073 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851219.634931:0:14373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:1.0:1788851219.634941:0:14373:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+9:2353:x1875746000861440:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788851219.634955:0:14373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788851219.634978:0:14373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a87957824e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff009 expref: 9 pid: 15073 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.634991:0:14373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a87957824e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff009 expref: 9 pid: 15073 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.635016:0:14373:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788851219.635021:0:14373:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788851219.635027:0:14373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879578255 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.635036:0:14373:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879578255 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.635066:0:14373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788851219.635134:0:14373:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+9:2353:x1875746000861440:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 193us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851219.635142:0:14373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00010000:00010000:0.0:1788851219.635338:0:15074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aca4502d/0x7ad3e1a87957824e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff009 expref: 8 pid: 15073 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851219.635364:0:15074:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9b99173480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15074:1875746019718272:192.168.204.6@tcp:104: 00010000:00010000:0.0:1788851219.635398:0:15074:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879578255 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.635410:0:15074:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879578255 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.635419:0:15074:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879578255 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.635472:0:15074:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879578255 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.635494:0:15074:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879578255 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.635504:0:15074:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879578255 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.635511:0:15074:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9a83031200 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:0.0:1788851219.635516:0:15074:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879578255 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.635525:0:15074:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879578255 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.635543:0:15074:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879578255 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.635551:0:15074:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17107b3/0x7ad3e1a879578255 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788851219.635642:0:15074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+7:2352:x1875746000861312:12345-192.168.204.6@tcp:1:lhsmtool_posix.0 Request processed in 7966us (8483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788851219.635652:0:15074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 19 00000100:00100000:1.0:1788851219.640277:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851219.644302:0:15800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000861696 00000100:00100000:0.0:1788851219.644321:0:15800:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000861696 00000100:00100000:1.0:1788851219.647420:0:15800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 60 00000100:00100000:1.0:1788851219.647435:0:15800:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+13:14565:x1875746000861696:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788851219.647553:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a87957825c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.647572:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a87957825c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.647584:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a87957825c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.647872:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879578263 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.647885:0:15800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957822b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeff4 expref: 14 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.647893:0:15800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879578263 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.647931:0:15800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957822b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeff4 expref: 14 pid: 15800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.647945:0:15800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957822b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeff4 expref: 14 pid: 15800 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851219.647959:0:15800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15800:1875746019718400:192.168.204.6@tcp:104: 00000100:00100000:1.0:1788851219.648050:0:15800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b87c18540 going to sleep for 11 seconds 00000100:00100000:1.0:1788851219.654266:0:15800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15800:1875746019718400:192.168.204.6@tcp:104: 00010000:00010000:1.0:1788851219.654301:0:15800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879578263 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851219.658243:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.660015:0:14374:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000861824 00000100:00100000:2.0:1788851219.660032:0:14374:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000861824 00010000:00010000:2.0:1788851219.660156:0:14374:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957822b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeff4 expref: 15 pid: 15800 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788851219.660259:0:14374:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 16 00000100:00100000:2.0:1788851219.660271:0:14374:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+15:2352:x1875746000861824:12345-192.168.204.6@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788851219.660287:0:14374:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788851219.660294:0:14374:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957822b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeff4 expref: 15 pid: 15800 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.660309:0:14374:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957822b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeff4 expref: 15 pid: 15800 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.660354:0:14374:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a87957822b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfeff4 expref: 15 pid: 15800 timeout: 652 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.660371:0:14374:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a9b990e2c00) 00010000:00010000:2.0:1788851219.660378:0:14374:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879578263 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.660388:0:14374:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879578263 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.660396:0:14374:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879578263 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.660440:0:14374:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788851219.660513:0:14374:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a20f2a44-3f34-4fab-952c-679d966a5b8b+14:2352:x1875746000861824:12345-192.168.204.6@tcp:103:ldlm_bl.0 Request processed in 244us (2281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851219.660521:0:14374:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 16 00010000:00010000:3.0:1788851219.660587:0:15800:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879578263 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.660596:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879578263 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788851219.660810:0:15800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1788851219.660973:0:15800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1788851219.661026:0:15800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1788851219.661137:0:15800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15800:1875746019718528:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788851219.661244:0:15800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851219.661279:0:15800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b9066bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788851219.661338:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019718528 00000100:00100000:3.0:1788851219.661344:0:14393:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019718528 00000100:00100000:3.0:1788851219.661374:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788851219.661381:0:14393:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15800:x1875746019718528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788851219.661447:0:14393:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15800:x1875746019718528:12345-0@lo:1000:mdt00_003.0 Request processed in 66us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851219.661454:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788851219.661594:0:15800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15800:1875746019718528:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788851219.662271:0:15800:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1788851219.662349:0:15800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3665500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15800:1875746019718656:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788851219.662393:0:15800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788851219.662414:0:15800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b98a21540 going to sleep for 11 seconds 00000100:00100000:3.0:1788851219.662529:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019718656 00000100:00100000:3.0:1788851219.662534:0:14393:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019718656 00000100:00100000:3.0:1788851219.662567:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788851219.662573:0:14393:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bb3664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15800:x1875746019718656:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788851219.662730:0:14393:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bb3664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15800:x1875746019718656:12345-0@lo:1000:mdt00_003.0 Request processed in 156us (336us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788851219.662737:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788851219.662775:0:15800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3665500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15800:1875746019718656:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788851219.662825:0:15800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879578263 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.662835:0:15800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879578263 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.662843:0:15800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879578263 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.662849:0:15800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef58800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851219.662853:0:15800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879578263 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.662861:0:15800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879578263 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.662876:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a9b990e2c00) 00010000:00010000:3.0:1788851219.662879:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788851219.662892:0:15800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879578263 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.662898:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef58800/0x7ad3e1a879578263 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.662929:0:15800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a8795781bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.662936:0:15800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a8795781bb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.662942:0:15800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a8795781bb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.662947:0:15800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7a00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851219.662950:0:15800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a8795781bb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.662956:0:15800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a8795781bb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.662965:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9bbcd02e00) 00010000:00010000:3.0:1788851219.662967:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788851219.662973:0:15800:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefd8 expref: 17 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.662985:0:15800:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781c2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefd8 expref: 17 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.662994:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefd8 expref: 17 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.663032:0:15800:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59e00/0x7ad3e1a8795781c2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cfefd8 expref: 17 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851219.663044:0:15800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9bb3667100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15800:1875746019718784:192.168.204.6@tcp:105: 00000100:00100000:3.0:1788851219.663098:0:15800:0:(client.c:2716:ptlrpc_set_wait()) set ffff8a9b8be34000 going to sleep for 11 seconds 00000100:00100000:3.0:1788851219.671831:0:15800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9bb3667100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15800:1875746019718784:192.168.204.6@tcp:105: 00010000:00010000:3.0:1788851219.671876:0:15800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a8795781bb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.671887:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7a00/0x7ad3e1a8795781bb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672031:0:15800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957826a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672047:0:15800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957826a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672068:0:15800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957826a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672080:0:15800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957826a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672086:0:15800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957826a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672092:0:15800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957826a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672117:0:15800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f800 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851219.672122:0:15800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957826a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672129:0:15800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957826a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672142:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9bbcd02e00) 00010000:00010000:3.0:1788851219.672145:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851219.672149:0:15800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957826a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672155:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f800/0x7ad3e1a87957826a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672166:0:15800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a87957825c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672171:0:15800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a87957825c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672178:0:15800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a87957825c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672183:0:15800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9baef59000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851219.672186:0:15800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a87957825c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672191:0:15800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a87957825c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672212:0:15800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9bbcd02e00) 00010000:00010000:3.0:1788851219.672214:0:15800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788851219.672217:0:15800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a87957825c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.672223:0:15800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9baef59000/0x7ad3e1a87957825c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15800 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851219.672514:0:15800:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a20f2a44-3f34-4fab-952c-679d966a5b8b+17:14565:x1875746000861696:12345-192.168.204.6@tcp:57:lhsmtool_posix.0 Request processed in 25080us (32244us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1788851219.672525:0:15800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 60 00000020:00080000:3.0:1788851219.672532:0:15800:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788851219.673532:0:14423:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788851219.673539:0:14423:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788851219.673573:0:14423:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788851219.673578:0:14423:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788851219.674043:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.676288:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000861952 00000100:00100000:2.0:1788851219.676305:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000861952 00000100:00100000:2.0:1788851219.676383:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:2.0:1788851219.676395:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+17:14564:x1875746000861952:12345-192.168.204.6@tcp:49:bash.0 00000100:00100000:2.0:1788851219.676634:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+17:14564:x1875746000861952:12345-192.168.204.6@tcp:49:bash.0 Request processed in 241us (2594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788851219.676642:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 12 00000100:00100000:0.0:1788851219.698977:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.699187:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000862208 00000100:00100000:2.0:1788851219.699198:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000862208 00000100:00100000:2.0:1788851219.699250:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 13 00000100:00100000:2.0:1788851219.699278:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+17:14565:x1875746000862208:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788851219.700384:0:14391:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788851219.700535:0:14391:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1788851219.700590:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578271 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.700607:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578271 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.700619:0:14391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578271 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.700628:0:14391:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578271 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.700635:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578271 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.700641:0:14391:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578271 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788851219.700714:0:14391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788851219.700858:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+19:14565:x1875746000862208:12345-192.168.204.6@tcp:35:lhsmtool_posix.0 Request processed in 1581us (1889us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1788851219.700867:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 13 00000020:00080000:2.0:1788851219.700872:0:14391:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788851219.701395:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851219.701514:0:15072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000862336 00000100:00100000:3.0:1788851219.701522:0:15072:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000862336 00000100:00100000:3.0:1788851219.701572:0:15072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 20 00000100:00100000:3.0:1788851219.701581:0:15072:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9b99172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+7:14564:x1875746000862336:12345-192.168.204.6@tcp:101:bash.0 00010000:00010000:3.0:1788851219.701595:0:15072:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788851219.701612:0:15072:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2df5e23/0x7ad3e1a879578278 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cff010 expref: -99 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788851219.701636:0:15072:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9fb412, atime: 0x6a9fb411, ctime: 0x6a9fb412, blocks: 0x1 00010000:00010000:3.0:1788851219.701654:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=552s v=(0 0) 00010000:00010000:3.0:1788851219.701659:0:15072:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788851219.701668:0:15072:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2df5e23/0x7ad3e1a879578278 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff010 expref: 8 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.701683:0:15072:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a2df5e23/0x7ad3e1a879578278 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff010 expref: 8 pid: 15072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.701705:0:15072:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9b8168f800, rc 0) 00000100:00100000:3.0:1788851219.701753:0:15072:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9b99172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+8:14564:x1875746000862336:12345-192.168.204.6@tcp:101:bash.0 Request processed in 172us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851219.701759:0:15072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 20 00010000:00010000:1.0:1788851219.704281:0:16010:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788851219.704296:0:16010:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578271 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.704307:0:16010:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b98af7800 already unused, calling callback (ffffffffc16958b0) 00010000:00010000:1.0:1788851219.704312:0:16010:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578271 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.704322:0:16010:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578271 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.704341:0:16010:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8a9b990e2c00) 00010000:00010000:1.0:1788851219.704345:0:16010:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788851219.704351:0:16010:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578271 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788851219.704357:0:16010:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b98af7800/0x7ad3e1a879578271 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14391 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788851219.706957:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.707565:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000862592 00000100:00100000:2.0:1788851219.707577:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000862592 00000100:00100000:2.0:1788851219.707640:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 14 00000100:00100000:2.0:1788851219.707651:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+19:14564:x1875746000862592:12345-192.168.204.6@tcp:35:bash.0 00000001:00080000:2.0:1788851219.708129:0:14391:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:2.0:1788851219.708226:0:14391:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1788851219.708342:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+22:14564:x1875746000862592:12345-192.168.204.6@tcp:35:bash.0 Request processed in 691us (1394us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1788851219.708350:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 14 00000020:00080000:2.0:1788851219.708355:0:14391:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788851219.710763:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851219.710772:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788851219.710774:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851219.819986:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:0.0:1788851219.820273:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000862848 00000100:00100000:0.0:1788851219.820284:0:14388:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000862848 00000100:00100000:0.0:1788851219.820348:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:0.0:1788851219.820360:0:14388:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+22:14575:x1875746000862848:12345-192.168.204.6@tcp:101:lfs.0 00010000:00010000:0.0:1788851219.820386:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788851219.820410:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030a00/0x7ad3e1a87957827f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7516d89bf8cff017 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788851219.820678:0:14388:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788851219.820862:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030a00/0x7ad3e1a87957827f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff017 expref: 24 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.820879:0:14388:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8a9bbcd02700) 00010000:00010000:0.0:1788851219.820882:0:14388:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788851219.820888:0:14388:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9a83030a00/0x7ad3e1a87957827f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.6@tcp remote: 0x7516d89bf8cff017 expref: 24 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788851219.820903:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8a9a83030a00, rc 0) 00000100:00100000:0.0:1788851219.825001:0:14388:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+23:14575:x1875746000862848:12345-192.168.204.6@tcp:101:lfs.0 Request processed in 4629us (5011us total) trans 8589934634 rc 301/301 00000100:00100000:0.0:1788851219.825015:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 61 00000100:00100000:1.0:1788851219.837092:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:3.0:1788851219.837467:0:14390:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000862976 00000100:00100000:3.0:1788851219.837480:0:14390:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000862976 00000100:00100000:3.0:1788851219.837584:0:14390:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 62 00000100:00100000:3.0:1788851219.837595:0:14390:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+23:14575:x1875746000862976:12345-192.168.204.6@tcp:34:lfs.0 00010000:00010000:3.0:1788851219.837676:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a87957828d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.837694:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a87957828d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.837706:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a87957828d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.837722:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879578294 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.837729:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879578294 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.837750:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879578294 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.838036:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a87957829b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.838066:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a87957829b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.838081:0:14390:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a87957829b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788851219.838868:0:14390:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a87957829b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.838886:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a87957828d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.838894:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a87957828d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.838901:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a87957828d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.838908:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168ea00 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851219.838913:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a87957828d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.838921:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a87957828d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.838936:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8a9bbcd02000) 00010000:00010000:3.0:1788851219.838939:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851219.838945:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a87957828d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.839209:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168ea00/0x7ad3e1a87957828d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.839239:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879578294 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.839245:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879578294 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.839252:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879578294 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.839256:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168e000 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851219.839451:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879578294 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.839472:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879578294 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.839482:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8a9b84f2f900) 00010000:00010000:3.0:1788851219.839485:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851219.839488:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879578294 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.839493:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168e000/0x7ad3e1a879578294 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.839512:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a87957829b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.839518:0:14390:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a87957829b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.839524:0:14390:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a87957829b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.839535:0:14390:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8a9b8168f200 already unused, calling callback (ffffffffc20f24f0) 00010000:00010000:3.0:1788851219.839539:0:14390:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a87957829b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.839545:0:14390:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a87957829b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.839554:0:14390:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8a9bbcd02e00) 00010000:00010000:3.0:1788851219.839556:0:14390:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788851219.839560:0:14390:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a87957829b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788851219.839565:0:14390:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8a9b8168f200/0x7ad3e1a87957829b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14390 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788851219.839746:0:14390:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a20f2a44-3f34-4fab-952c-679d966a5b8b+23:14575:x1875746000862976:12345-192.168.204.6@tcp:34:lfs.0 Request processed in 2148us (2659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788851219.839756:0:14390:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 62 00000100:00100000:1.0:1788851219.846289:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.6@tcp (source: 12345-192.168.204.6@tcp) 00000100:00100000:2.0:1788851219.847335:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746000863232 00000100:00100000:2.0:1788851219.847349:0:14391:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746000863232 00000100:00100000:2.0:1788851219.847424:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.6@tcp, seq: 15 00000100:00100000:2.0:1788851219.847435:0:14391:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9baf4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+23:14575:x1875746000863232:12345-192.168.204.6@tcp:35:lfs.0 00000100:00100000:2.0:1788851219.847692:0:14391:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9baf4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a20f2a44-3f34-4fab-952c-679d966a5b8b+24:14575:x1875746000863232:12345-192.168.204.6@tcp:35:lfs.0 Request processed in 259us (1413us total) trans 8589934635 rc 0/0 00000100:00100000:2.0:1788851219.847701:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.6@tcp, seq: 15 00010000:00010000:1.0:1788851219.987031:0:14377:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788851220.031758:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:0.0:1788851220.031778:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:0.0:1788851220.031846:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00010000:00010000:1.0:1788851221.011082:0:14376:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788851221.246372:0:16656:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:0.0:1788851222.034116:0:16010:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788851222.546116:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8a9baf4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019718912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788851222.546195:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788851222.546298:0:16267:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875746019718912 00000100:00100000:1.0:1788851222.546306:0:16267:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875746019718912 00000100:00100000:1.0:1788851222.546371:0:16267:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788851222.546382:0:16267:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8a9bafcf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019718912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788851222.546429:0:16267:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788851222.546480:0:16267:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8a9bafcf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875746019718912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788851222.546487:0:16267:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788851222.546551:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8a9baf4d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1875746019718912:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788851222.546669:0:14384:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 Debug log: 29877 lines, 29877 kept, 0 dropped, 0 bad.